Full Job Description
Lead Data Engineer with Terraform
We are seeking an experienced Lead Data Engineer with strong Terraform expertise to design, build and maintain scalable data solutions on Google Cloud Platform. In this role, you will lead the development of robust data pipelines while driving best practices across infrastructure automation and DevOps processes.
Responsibilities
Design and build scalable data pipelines using GCP services
Lead the development of data solutions leveraging BigQuery, Dataflow and Dataform/dbt
Orchestrate workflows with Cloud Composer/Airflow
Manage real-time data streaming through Pub/Sub and Cloud Storage
Implement infrastructure as code using Terraform
Establish and maintain CI/CD pipelines with GitHub Actions
Collaborate with stakeholders to translate business requirements into technical solutions
Ensure data quality, reliability and performance across all systems
Mentor team members and promote engineering best practices
Requirements
5+ years of hands-on experience with SQL and Python
Expertise in GCP services including BigQuery, Dataflow and Dataform/dbt
Proficiency in Cloud Composer/Airflow, Pub/Sub and Cloud Storage
Skills in DevOps practices including CI/CD, GitHub Actions and Terraform
Good verbal and written communication skills
Good business acumen
English proficiency at B2 level or higher
Nice to have
Google Cloud Professional Data Engineer Certified
Familiarity with Data Lake technologies such as Iceberg
Knowledge of CDC using Datastream
Understanding of Dataplex, Knowledge Catalog and Analytics Hub
Competency in Looker