GCP Data Engineer

IVidTek, Inc.

$110K — $135K *
Enterprise Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 6+ years of hands-on data engineering experience, focusing on GCP data stack components.
  • Deep proficiency in BigQuery, Cloud Dataflow, Pub/Sub, SQL, and Python/PySpark.
  • Solid understanding of distributed computing and real-time streaming architectures.
  • Experience with data modeling techniques like Kimball or Star Schema.
  • Familiarity with Docker/GKE for containerization and Terraform for Infrastructure as Code is a plus.
  • GCP Professional Data Engineer certification preferred.

Responsibilities

  • Design, deploy, and maintain scalable data pipelines using GCP services like BigQuery and Cloud Dataflow.
  • Build automated ETL/ELT workflows using tools such as Cloud Composer or Prefect.
  • Optimize query performance and schema design for large datasets in BigQuery.
  • Ingest and process various data streams in real-time and batch modes.
  • Implement data security, governance, quality checks, and access controls.
  • Write clean, efficient, and well-tested code in Python, PySpark, or SQL.

Benefits

  • Opportunity to work on cutting-edge cloud data technologies.
  • Collaborative environment with analytics and engineering teams.
  • Flexibility to manage both real-time and batch data processing.
  • Focus on designing scalable solutions for complex data challenges.
  • Professional development through potential certifications.
Full Job Description
About the Job

Job Summary:

We are seeking an experienced GCP Data Engineer to design, build, and optimize our scalable cloud data platform. In this role, you will architect real-time and batch ELT/ETL data pipelines, manage data lakes and enterprise warehouses, and ensure seamless integration across our cloud environment. You will collaborate closely with analytics and engineering teams to transform complex raw data into reliable, high-performance data assets.

Key Responsibilities:

  • Design, deploy, and maintain scalable data pipelines using Google Cloud Platform (GCP) services like BigQuery, Cloud Dataflow, Pub/Sub, Dataproc, and Cloud Storage (GCS).
  • Build automated ETL/ELT workflows using orchestration tools such as Cloud Composer (Apache Airflow) or Prefect.
  • Optimize query performance, schema design, and partitioning strategies in BigQuery for large-scale datasets.
  • Ingest and process structured, semi-structured, and unstructured data streams in both real-time and batch modes.
  • Implement robust data security, governance, quality checks, and access controls across cloud data assets.
  • Write clean, efficient, and well-tested code in Python, PySpark, or SQL.


Requirements & Qualifications:

  • Experience: 6+ years of hands-on data engineering experience, with a strong focus on native GCP data stack components.
  • Core Tech Stack: Deep proficiency in BigQuery, Cloud Dataflow (Apache Beam), Pub/Sub, SQL, and Python/PySpark.
  • Big Data & Streaming: Solid understanding of distributed computing, real-time streaming architectures, and data modeling (Kimball, Star Schema).
  • CI/CD & DevOps: Experience with containerization (Docker/GKE) and Infrastructure as Code (Terraform) is a plus.
  • Certifications: GCP Professional Data Engineer certification is highly desirable.

Similar Jobs

More Jobs at IVidTek, Inc.

More Enterprise Technology Jobs

Find similar GCP Data Engineer jobs: