DBT/Python/Airflow Engineer

Compunnel

$110K — $130K *
Oaks, PA 19456In-Person
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of DBT experience with hands-on model development.
  • 3+ years of Python development expertise.
  • 3+ years of experience with Airflow.
  • 3+ years of experience managing Snowflake databases.
  • Strong SQL skills necessary for data manipulation.
  • Solid understanding of data warehousing fundamentals.
  • Experience in building scalable ELT/ETL pipelines.

Responsibilities

  • Develop and maintain DBT models and macros using SQL.
  • Design and optimize data models, including Star/Snowflake schemas.
  • Manage and enhance Snowflake warehouse performance.
  • Create robust ELT/ETL pipelines for diverse data sources.
  • Write modular SQL code and manage DBT version control.
  • Develop and manage Airflow workflows for data pipelines.
  • Implement data quality checks and automate testing procedures.
  • Apply Snowflake security measures like RBAC and data masking.

Benefits

  • Opportunity to work with cutting-edge data technologies.
  • Collaborative work environment focused on innovation.
  • Potential for career advancement in data engineering.
  • Access to continued learning and professional development opportunities.
  • Flexible working arrangements.
Full Job Description
Job Summary

We are seeking a DBT/Python/Airflow Engineer with strong hands-on experience developing data transformation and ELT/ETL solutions using DBT, Python, Airflow, Snowflake, and SQL. The role will focus on developing and maintaining DBT models and scalable data pipelines, optimizing data warehouse models and performance, implementing data quality and automated testing frameworks, and applying Snowflake security controls. The ideal candidate will have a strong understanding of data warehousing concepts and experience working with modern cloud data platforms.

Key Responsibilities
• Develop and maintain DBT models, macros, and SQL scripts to transform data within Snowflake.
• Design and optimize data models, including Star and Snowflake schemas.
• Manage and optimize Snowflake warehouse performance, including clustering and materialized views.
• Create scalable ELT/ETL pipelines to ingest and transform data from diverse sources.
• Develop modular and testable SQL code using version control and maintain well-structured DBT projects.
• Develop and maintain Airflow-based data pipelines and workflows.
• Implement data quality checks, automated tests, and anomaly detection processes.
• Implement Snowflake data security controls, including RBAC, masking, and row-level access.
• Troubleshoot and optimize data transformations, pipelines, and warehouse workloads.

Required Qualifications
• 5+ years of experience with DBT, including hands-on experience developing DBT models and projects.
• 3+ years of experience with Python development.
• 3+ years of experience with Airflow development.
• 3+ years of experience with Snowflake.
• Strong SQL proficiency.
• Strong understanding of data warehousing concepts.
• Experience developing scalable ELT/ETL pipelines and data transformation solutions.
• Experience with data modeling, including Star and Snowflake schemas.
• Bachelor's degree in Computer Science, Data Engineering, or a related field.

Preferred Qualifications
• Experience working with cloud platforms such as AWS, GCP, or Azure.

Similar Jobs

More Jobs at Compunnel

  • .NET Developer
    $95K — $115K *
    Minneapolis, MN 55407 (Hennepin County)
    Healthcare
    In-Person
  • AI Engineer
    $150K — $180K *
    San Francisco, CA 94112 (San Francisco County)
    Information Technology
    In-Person
  • AI Architect
    $145K — $175K *
    Pittsburgh, PA 15237 (Allegheny County)
    Information Technology
    In-Person
  • Data Engineer with AWS
    $110K — $130K *
    Malvern, PA 19355 (Chester County)
    Information Technology
    In-Person
  • SAP UI5 Fullstack Developer
    $110K — $130K *
    San Antonio, TX 78228 (Bexar County)
    Information Technology
    In-Person

More Information Technology Jobs

Find similar DBT/Python/Airflow Engineer jobs: