Software Data Engineer / Apache Airflow

Gigatec Engineering

• $100K — $130K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Top Secret clearance required
  • Experience with Linux CLI and tools
  • Proficient in Bash scripting for automation
  • Recent software development experience in Python and Java
  • Expertise in Apache Airflow for workflow management
  • Familiarity with Apache Spark for big data processing
  • Knowledge of Docker and containerization technologies

Responsibilities

  • Design and implement Apache Airflow pipelines for data workflows
  • Ensure reliable data movement for analytics and operations
  • Automate manual processes using developed Bash scripts
  • Monitor and optimize existing workflow systems
  • Collaborate with team members on software development
  • Utilize Git for version control and project management

Benefits

  • 100% Paid Healthcare
  • 10% 401k contribution in every paycheck
  • 100% Fully vested in 401k immediately
Full Job Description
Perks and Benefits
  • 100% Paid Healthcare
  • 10% 401k in every paycheck
  • 100% Fully Vested!

NOTE - Our positions require a Top Secret clearance, as well as the favorable completion of a polygraph. Applicants must be authorized to work in the U.S. We are unable to sponsor an employment Visa.

What You'll Be Doing (We don't love the bullet points, but we love the work!)
In this key SW Data Engineering role, you'll get to build the workflow engines behind the curtain, designing reliable Apache Airflow pipelines that keep data moving cleanly, efficiently, and on schedule for analytics and operational needs.Required Skills
  • Experience using the Linux CLI and Linux tools
  • Experience developing Bash scripts to automate manual processes
  • Recent software development experience using Python and Java
  • Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
  • Experience using Distributed Big Data processing engines including Apache Spark
  • Experience with containerization technologies such as Docker, containerd, and Podman
  • Experience with Git Source Control System
Desired Skills
  • Experience using the Atlassian Tool Suite (JIRA, Confluence)
  • Familiar with AWS Cloud Services and Infrastructure
  • Appreciates a sense of humor and the occasional well-timed joke. 😄

Similar Jobs

More Jobs at Gigatec Engineering

  • Full Stack Software Engineer
    $90K — $130K *
    Annapolis, MD 21401 (Anne Arundel County)
    Enterprise Technology
    In-Person
  • Full Stack Software Engineer
    $100K — $130K *
    Annapolis Junction, MD 20701 (Howard County)
    Information Technology
    In-Person
  • Senior System Administrator
    $100K — $130K *
    Annapolis Junction, MD 20701 (Howard County)
    Information Technology
    In-Person
  • Lead Software Engineer
    $110K — $140K *
    Annapolis, MD 21401 (Anne Arundel County)
    Aerospace & Defense
    In-Person
  • Automation Engineer
    $90K — $120K *
    Annapolis, MD 21401 (Anne Arundel County)
    Aerospace & Defense
    In-Person

More Information Technology Jobs

Find similar Software Data Engineer / Apache Airflow jobs: