QualiTest Group

Data Engineer

QualiTest Group$110K — $120K *
Enterprise Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience in data engineering or related fields.
  • Proficiency in building end-to-end data pipelines with batch and streaming capabilities.
  • Experience with cloud data platforms like Databricks or Snowflake.
  • Strong command of Python and PySpark with a focus on performance tuning.
  • Familiarity with CI/CD, DevOps practices, and infrastructure as code tools.

Responsibilities

  • Design and develop end-to-end data pipelines for efficient data ingestion and processing.
  • Implement and optimize PySpark scripts for scalable data transformation.
  • Monitor and ensure the performance of data pipelines and cloud-based architecture.
  • Collaborate with cross-functional teams to create reusable and reliable data solutions.
  • Apply best practices in Medallion Architecture for data quality and transformation.

Benefits

  • Remote work flexibility within the U.S.
  • Opportunities for professional development and upskilling.
  • Collaborative work environment with diverse teams.
  • Access to modern data tools and cloud technologies.
Full Job Description
We are looking for a Data Engineer to join our growing team in United States

Location: US Remote

Top 3 Must Haves:
1. Experience building end-to-end data pipelines (batch/streaming, orchestration, monitoring)
2. Practical exposure to modern cloud data platforms (Databricks, Snowflake)
3. Strong hands-on PySpark with Spark performance tuning (joins, partitioning, caching, optimization)

Job Description:
-Strong hands-on experience in Python and PySpark, with a solid understanding of Spark concepts, performance tuning, and scalable data processing.
-Experience working with modern data management platforms such as Snowflake, Databricks, or similar cloud-based data platforms.
-Good understanding of data pipeline design, development, orchestration, and monitoring, including batch and streaming data processing.
-Familiarity with Medallion Architecture concepts, including bronze, silver, and gold layer design and best practices for data transformation.
-Strong understanding of autoscaling, cluster optimization, and cost-efficient data processing in cloud or distributed data environments.
-Experience with CI/CD, DevOps practices, and version control, with preference for candidates who have exposure to Terraform or infrastructure-as-code tools.
-Ability to collaborate with business, analytics, and engineering teams to design reliable, reusable, and scalable data solutions.

Benefits

About QualiTest Group

Size
3,500 employees
Industry
Founded
1983

Similar Jobs

More Jobs at QualiTest Group

  • QualiTest Group
    Data Engineer
    $110K — $120K *
    Santa Clara, CA 95051 (Santa Clara County)
    Enterprise Technology
    In-Person
  • QualiTest Group
    Unify Test Lead
    $140K — $160K *
    Santa Clara, CA 95051 (Santa Clara County)
    Information Technology
    In-Person
  • Sr QA Engineer (Automation)
    $80K — $85K *
    Santa Clara, CA 95051 (Santa Clara County)
    Transportation
    In-Person
  • AI Solutions & Enablement Engineer
    $110K — $120K *
    Santa Clara, CA 95051 (Santa Clara County)
    Enterprise Technology
    In-Person
  • CI/CD Engineer
    $110K — $120K *
    Santa Clara, CA 95051 (Santa Clara County)
    Information Technology
    In-Person

More Enterprise Technology Jobs

Find similar Data Engineer jobs: