Bachelor's degree in Computer Science, Software Engineering, or a related field (or equivalent experience).
3 years of experience as a Data Engineer with a focus on Google Cloud (GCP) technologies.
Proficiency in building ETL pipelines using BigQuery and Dataflow for large-scale data processing.
Experience with pipeline automation and optimization on GCP for analytics workloads.
Strong understanding of cloud-based data engineering and distributed data systems.
Responsibilities
Design and implement data pipelines on Google Cloud using BigQuery and Dataflow for efficient ETL workflows.
Develop and optimize data transformations to load and process data in BigQuery for analytics.
Automate data workflows to ensure seamless integration and delivery of data across systems.
Collaborate with data analysts to provide clean, reliable data for reporting and visualization.
Monitor and tune pipeline performance on GCP to ensure cost efficiency and scalability.
Troubleshoot and resolve issues in data pipelines to maintain data integrity and availability.
Benefits
Competitive salary and comprehensive benefits package (healthcare, PTO, 401k).
Opportunities for professional growth and upskilling in AI and cloud technologies.
Full Job Description
Overview:
Cloud Data Engineer (GCP BigQuery & Dataflow)
Location: Alpharetta, GA (willing to travel to client locations)
Employment Type: Full-Time (W2)
Role Overview
We are seeking a talented Cloud Data Engineer to design and manage data pipelines on Google Cloud using BigQuery and Dataflow. This role focuses on building scalable ETL processes to support data analytics and insights for enterprise applications.
Key Responsibilities
Design and implement data pipelines on Google Cloud using BigQuery and Dataflow for efficient ETL workflows.
Develop and optimize data transformations to load and process data in BigQuery for analytics.
Automate data workflows to ensure seamless integration and delivery of data across systems.
Collaborate with data analysts to provide clean, reliable data for reporting and visualization.
Monitor and tune pipeline performance on GCP to ensure cost efficiency and scalability.
Troubleshoot and resolve issues in data pipelines to maintain data integrity and availability.
Required Qualifications
Bachelor's degree in Computer Science, Software Engineering, or a related field (or equivalent experience).
3 years of experience as a Data Engineer with a focus on Google Cloud (GCP) technologies.
Proficiency in building ETL pipelines using BigQuery and Dataflow for large-scale data processing.
Experience with pipeline automation and optimization on GCP for analytics workloads.
Strong understanding of cloud-based data engineering and distributed data systems.
Preferred Qualifications
Familiarity with other GCP services like Pub/Sub or Cloud Storage for data integration.
Exposure to advanced BigQuery features like partitioning or clustering for performance optimization.
Knowledge of orchestration tools like Apache Airflow for managing GCP data workflows.
Compensation & Benefits
Competitive salary and comprehensive benefits package (healthcare, PTO, 401k).
Opportunities for professional growth and upskilling in AI and cloud technologies.
Skills:
Data Engineer, GCP, Google Cloud, BigQuery, Dataflow, ETL, Pipeline
