QualiTest Group

Data Engineer

QualiTest Group$110K — $120K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of experience in data engineering roles
  • Proficient in building end-to-end data pipelines, both batch and streaming
  • Hands-on experience with Python and PySpark
  • Familiarity with cloud platforms like Databricks and Snowflake
  • Knowledge of Medallion Architecture and data transformation best practices
  • Experience with DevOps practices including CI/CD and version control
  • Exposure to Terraform or infrastructure-as-code tools

Responsibilities

  • Build and maintain robust data pipelines for batch and streaming processes
  • Optimize Spark applications for performance and scalability
  • Collaborate with cross-functional teams to create reusable data solutions
  • Design and monitor data orchestration and workflow processes
  • Implement best practices for data processing and transformation
  • Manage and optimize cloud resource utilization
  • Ensure reliable and secure data access and storage solutions

Benefits

  • A competitive salary range of $110,000 - $120,000
  • Flexible remote work opportunity
  • Collaborative team environment focused on innovation and growth
  • Opportunity to work with cutting-edge data technologies
  • Access to ongoing training and development resources
Full Job Description
We are looking for a Data Engineer to join our growing team in United States

Location - US (remote)

Top 3 Must Haves:
1. Experience building end-to-end data pipelines (batch/streaming, orchestration, monitoring)
2. Practical exposure to modern cloud data platforms (Databricks, Snowflake)
3. Strong hands-on PySpark with Spark performance tuning (joins, partitioning, caching, optimization)

Job Description:
-Strong hands-on experience in Python and PySpark, with a solid understanding of Spark concepts, performance tuning, and scalable data processing.
-Experience working with modern data management platforms such as Snowflake, Databricks, or similar cloud-based data platforms.
-Good understanding of data pipeline design, development, orchestration, and monitoring, including batch and streaming data processing.
-Familiarity with Medallion Architecture concepts, including bronze, silver, and gold layer design and best practices for data transformation.
-Strong understanding of autoscaling, cluster optimization, and cost-efficient data processing in cloud or distributed data environments.
-Experience with CI/CD, DevOps practices, and version control, with preference for candidates who have exposure to Terraform or infrastructure-as-code tools.
-Ability to collaborate with business, analytics, and engineering teams to design reliable, reusable, and scalable data solutions.

Benefits

  • A Competitive pay, the salary range for the role is $110,000 - $120,000.
  • If you like what you have read, send us your resume and let's start talking!
  • About QualiTest Group

    Size
    3,500 employees
    Industry
    Founded
    1983

    Similar Jobs

    More Jobs at QualiTest Group

    • QualiTest Group
      Data Quality Engineer
      $80K — $100K *
      Santa Clara, CA 95051 (Santa Clara County)
      Enterprise Technology
      In-Person
    • Sr IT Project Manager - Agile Delivery & Operations
      $120K — $140K *
      Santa Clara, CA 95051 (Santa Clara County)
      Information Technology
      In-Person
    • Verification Engineer
      $80K — $100K *
      Santa Clara, CA 95051 (Santa Clara County)
      Pharmaceuticals & Biotech
      In-Person
    • Firmware Engineer
      $80K — $100K *
      Santa Clara, CA 95051 (Santa Clara County)
      Technical Services
      In-Person
    • QualiTest Group
      Unify Test Lead
      $140K — $160K *
      Santa Clara, CA 95051 (Santa Clara County)
      Information Technology
      In-Person

    More Information Technology Jobs

    Find similar Data Engineer jobs: