Data Warehouse Software Engineer III

Babel Street$120K — $135K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 4-7+ years of professional software development experience, particularly in data warehousing and cloud data pipelines.
  • Proficient in advanced Python development for data processing and API integrations.
  • Hands-on experience managing Apache Airflow, including DAG architecture and troubleshooting.
  • Deep understanding of GCP's analytics services, especially BigQuery and Cloud Storage.
  • Experience with optimization techniques for BigQuery and data governance.
  • Familiarity with CI/CD processes and version control using Git.

Responsibilities

  • Architect, build, and maintain ELT/ETL data pipelines for ingesting complex datasets into Google BigQuery.
  • Manage and upgrade the Apache Airflow platform, writing maintainable DAGs in Python.
  • Optimize core GCP data services, implementing performance tuning for BigQuery.
  • Develop Python scripts and automation tools for data extraction and integration.
  • Enforce data quality frameworks to ensure data integrity and minimal latency across pipelines.
  • Maintain CI/CD deployment pipelines and provide technical leadership to junior engineers.

Benefits

  • Babel Street covers 85-100% of monthly health insurance premiums for employees and their families.
  • Offers both Traditional and Roth 401(K) retirement plans with competitive matching.
  • Employees are provided with unlimited flexible leave to balance personal and work life.
  • Provides 12 paid federal holidays each year.
  • Tuition reimbursement program available for continuing education.
Full Job Description
We are looking for an experienced Data Warehouse Software Engineer III to own, scale, and optimize our core Google Cloud Platform (GCP) data warehousing and ingestion ecosystem!

In this role, you will be a key technical contributor responsible for architecting high-volume data ingestion pipelines into Google BigQuery, orchestrating complex workflow topologies in Apache Airflow (Cloud Composer), and maintaining the performance and reliability of our enterprise data warehouse. You will collaborate closely with cross-functional software, data, and analytics teams to integrate disparate commercial and government data sources into clean, highly available, and query-optimized data models.

This is an experienced engineering role requiring strong Python skills, deep expertise across the entire GCP analytics stack, and hands-on experience managing and upgrading production Airflow environments.

Key Responsibilities:
  • Data Warehouse & Pipeline Engineering: Architect, build, and maintain production-grade ELT/ETL data pipelines that stream and batch high-volume, complex datasets into Google BigQuery.
  • Airflow Management & Platform Upgrades: Manage, monitor, and upgrade our Apache Airflow / Cloud Composer platform. Write clean, modular, and maintainable DAGs in Python, implement custom operators/hooks, and optimize cluster performance.
  • GCP Architecture & Optimization: Maintain and optimize core GCP data services (BigQuery, Cloud Storage, Cloud Functions/Run, Pub/Sub, IAM). Implement advanced BigQuery performance tuning (partitioning, clustering, slot management, and query cost control).
  • Python Engineering & Integrations: Develop high-performance Python scripts, API connectors, and automation tools for data extraction, schema validation, and third-party data integrations.
  • Data Quality & Integrity: Enforce strict data quality frameworks, monitoring, and automated alerting across all ingestion pipelines to ensure zero data loss and minimal latency.
  • Technical Leadership & CI/CD: Maintain infrastructure-as-code and CI/CD deployment pipelines for data workloads using Git. Assist in architectural reviews and mentor junior engineers on data warehousing best practices.

Job Requirements:
  • U.S. Citizenship: Must be a U.S. Citizen due to federal government contract requirements.
  • Software Engineering Experience: 4-7+ years of professional software development experience, with at least 3+ years focused heavily on data warehousing, cloud data pipelines, and data platform operations.
  • Advanced Python Mastery: Production-grade Python development skills for data processing, custom pipeline tooling, and API integrations.
  • Airflow Platform Operations: Hands-on experience with Apache Airflow (Cloud Composer preferred), including DAG architecture, troubleshooting, environment configuration, and platform version upgrades.
  • GCP Ecosystem Expertise: Deep experience with the Google Cloud analytics suite-specifically BigQuery, Cloud Storage (GCS), Cloud Composer, Pub/Sub, and Cloud Functions/Run.
  • BigQuery Optimization: Advanced understanding of BigQuery architecture, DDL/DML, partitioning, clustering, slot allocation, and query cost-control strategies.
  • DevOps & Version Control: Proficient with Git, CI/CD pipelines, and modern software development workflows.

Preferred Qualifications:
  • GCP Certification: Google Cloud Certified Professional Data Engineer (highly preferred).
  • High-Volume Data Experience: Experience working with multi-terabyte or billion-row datasets, unstructured web-scraped data, or streaming architectures.

• Security & Compliance: Familiarity with government compliance frameworks, IAM policy design, and data encryption standards.

Benefits at Babel Street (just to name a few...)
  • Health Benefits: Babel Street covers 85-100% monthly premium costs for Medical, Dental, Vision, Life & Disability insurances - for you and your family!
  • Retirement Plans: Babel Street offers both a Traditional and Roth 401(K) with a very competitive match.
  • Unlimited Flexible Leave: We trust our employees to manage their own time and balance their personal and work lives.
  • Holidays: Babel Street provides employees with 12 paid Federal Holidays
  • Tuition Reimbursement: We are committed to investing in our employees. One way we do that is with our Tuition Reimbursement Program for continuing education.

Range for this position based on qualifications and experience

$120,000-$135,000 USD

About Babel Street

Babel Street is a software company that provides advanced data analytics and search capabilities to government agencies and private sector organizations. The company was founded in 2014 by Jeff Chapman and is headquartered in Reston, Virginia. Babel Street's flagship product is the Babel X platform, which allows users to search and analyze data from a wide range of sources, including social media, news articles, and public records. The platform uses advanced algorithms and machine learning to identify patterns and trends in large datasets, enabling users to make more informed decisions. Babel Street is committed to helping its customers stay ahead of emerging threats and opportunities.
Learn more about Babel Street
Size
50 employees
Industry
Founded
2014

Similar Jobs

More Jobs at Babel Street

More Information Technology Jobs

Find similar Data Warehouse Software Engineer III jobs: