EPAM Systems

Lead Data Engineer with Terraform

EPAM Systems$120K — $150K *
US-AnywhereRemote in Georgia, US
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience with SQL and Python
  • Strong expertise in GCP services including BigQuery, Dataflow and Dataform/dbt
  • Proficiency in orchestration tools like Cloud Composer/Airflow and real-time streaming using Pub/Sub
  • Experience with CI/CD practices, GitHub Actions and Terraform
  • Effective communication skills and business acumen at B2 English level or higher

Responsibilities

  • Design and build scalable data pipelines using Google Cloud Platform services
  • Lead the development of data solutions leveraging BigQuery, Dataflow and Dataform/dbt
  • Orchestrate workflows using Cloud Composer/Airflow
  • Manage real-time data streaming operations with Pub/Sub and Cloud Storage
  • Implement infrastructure as code practices using Terraform
  • Establish and maintain CI/CD pipelines with GitHub Actions
  • Mentor team members and promote engineering best practices

Benefits

  • Opportunity to lead innovative data projects
  • Engage with cutting-edge technologies on Google Cloud Platform
  • Collaborative work environment with focus on mentorship
  • Potential for career advancement in data engineering and cloud technologies
  • Exposure to diverse data challenges and solutions
Full Job Description
Lead Data Engineer with Terraform We are seeking an experienced Lead Data Engineer with strong Terraform expertise to design, build and maintain scalable data solutions on Google Cloud Platform. In this role, you will lead the development of robust data pipelines while driving best practices across infrastructure automation and DevOps processes. Responsibilities Design and build scalable data pipelines using GCP services Lead the development of data solutions leveraging BigQuery, Dataflow and Dataform/dbt Orchestrate workflows with Cloud Composer/Airflow Manage real-time data streaming through Pub/Sub and Cloud Storage Implement infrastructure as code using Terraform Establish and maintain CI/CD pipelines with GitHub Actions Collaborate with stakeholders to translate business requirements into technical solutions Ensure data quality, reliability and performance across all systems Mentor team members and promote engineering best practices Requirements 5+ years of hands-on experience with SQL and Python Expertise in GCP services including BigQuery, Dataflow and Dataform/dbt Proficiency in Cloud Composer/Airflow, Pub/Sub and Cloud Storage Skills in DevOps practices including CI/CD, GitHub Actions and Terraform Good verbal and written communication skills Good business acumen English proficiency at B2 level or higher Nice to have Google Cloud Professional Data Engineer Certified Familiarity with Data Lake technologies such as Iceberg Knowledge of CDC using Datastream Understanding of Dataplex, Knowledge Catalog and Analytics Hub Competency in Looker

About EPAM Systems

EPAM Systems, Inc. is a leading global provider of digital platform engineering and development services. The company has a strong presence in North America, Europe, and Asia, and serves clients in a variety of industries, including financial services, healthcare, and retail. EPAM's services include software engineering, product development, and digital platform engineering, and the company has a reputation for delivering high-quality solutions that help its clients achieve their business goals. EPAM has been recognized as a leader in the digital services industry by a number of independent research firms, and the company has won numerous awards for its work.
Learn more about EPAM Systems
Size
58,824 employees
Market Cap
$18.2 billion
Industry
Net Income
$327.1 million
Founded
1993
5 Year Trend
+26.5%
Revenue
$2.6 billion
NASDAQ

Similar Jobs

More Jobs at EPAM Systems

More Information Technology Jobs

Find similar Lead Data Engineer with Terraform jobs: