Data Engineering Lead

Hark

$170K — $450K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of relevant data engineering experience; background in AI or research-driven firms is preferred.
  • Proficient in designing and managing large-scale batch and streaming data pipelines with a focus on reliability.
  • Expertise in building data systems specifically for machine learning applications and understanding their unique requirements.
  • Familiar with modern data tools like Spark, Beam, or Flink, including data versioning systems such as DVC, Delta Lake, or Iceberg.
  • Strong systems thinking skills to handle schema evolution and potential production incidents effectively.
  • Instinctive sense for data quality, able to identify issues early and collaborate on solutions with data stakeholders.
  • Excellent communication skills to facilitate collaboration among model researchers and engineers.

Responsibilities

  • Develop and optimize scalable data pipelines for multi-modal training data (text, audio, vision).
  • Oversee the entire data infrastructure process, including ingestion, transformation, deduplication, and quality control.
  • Work with researchers and data collection leads to translate data needs into operational pipelines.
  • Create tools to evaluate and iterate on data quality, ensuring insights impact data collection decisions.
  • Establish and maintain data quality standards, embedding checks in pipelines to catch issues early.
  • Design systems for data reproducibility and scalability, ensuring efficiency under increasing data loads.
  • Identify weaknesses in the current data systems and lead enhancements for throughput and reliability.

Benefits

  • Collaborative work environment with a small, motivated team.
  • Directly influence the pace and quality of model development.
  • Opportunity to work closely with leading researchers in AI.
  • Engagement in high-ownership role with significant impact.
  • Exposure to cutting-edge data engineering challenges.
Full Job Description
About the Role

You'll build the data infrastructure that turns raw signals into the training data Hark's models learn from, and the pipelines that keep it flowing at scale.

That means owning the full data engineering stack: ingestion, transformation, quality filtering, and delivery to training and evaluation systems. The models we ship are only as good as the data behind them, and this role owns that foundation.

This is a high-ownership role on a small team. You'll work directly with model researchers, data collection leads, and infrastructure engineers, and the systems you build will directly shape the quality and pace of model development.

Responsibilities
  • Design and build scalable data pipelines that ingest, process, and deliver training data across multiple modalities: text, audio, vision, and structured feedback signals.
  • Own the data infrastructure stack end-to-end: ingestion, transformation, deduplication, quality filtering, versioning, and delivery to model training and evaluation systems.
  • Collaborate closely with model researchers and data collection leads to understand data requirements and translate them into reliable, auditable pipelines.
  • Build tooling and frameworks that make it easy for the team to inspect, evaluate, and iterate on data quality. The insights surfaced should feed back into collection and curation decisions.
  • Define and enforce data quality standards. Instrument pipelines for correctness, freshness, and coverage. Catch regressions before they reach training.
  • Design data systems for reproducibility and scale. The pipelines you build need to handle growing volumes across modalities without becoming a bottleneck.
  • Identify gaps in the current stack and drive concrete improvements to throughput, quality, and reliability.

Requirements
  • Strong data engineering fundamentals. You are comfortable designing and operating large-scale batch and streaming pipelines, and you care about correctness and reliability.
  • Experience building data systems for machine learning. You understand the difference between a data pipeline for analytics and one that feeds model training, and you know what it takes to get the latter right.
  • Fluency with the modern data stack. You've worked with tools like Spark, Beam, or Flink, and you know how to make tradeoffs between them. Experience with data versioning systems (e.g., DVC, Delta Lake, Iceberg) is a strong plus.
  • Systems thinking. You reason about schema evolution, backfills, and failure modes before they become production incidents. You build for the day-2 case, not just the demo.
  • A quality instinct. You don't just move data. You understand what's in it, catch problems early, and close the feedback loop with the people who need clean data.
  • Strong communication. You can work closely with model researchers and engineers, explain data tradeoffs clearly, and make good decisions across team boundaries.
  • 5+ years of relevant data engineering experience. Experience at a fast-growing AI or research-driven company is a strong plus.

Bonus Qualifications
  • Experience building data infrastructure for large language model or multimodal model training.
  • Familiarity with multimodal data formats and processing pipelines (audio, video, image).
  • Experience with human feedback or preference data pipelines (RLHF, DPO, or similar).
  • Hands-on experience with data quality evaluation frameworks or annotation tooling.
  • Background in distributed systems, stream processing, or large-scale ETL.
  • Experience at a fast-moving AI lab or research-driven company.

Compensation

The US base salary range for this full-time position is between $170,000 - $450,000 annually.

The pay offered for this position may vary based on several individual factors, including job-related knowledge, skills, and experience. The total compensation package may also include additional components/benefits depending on the specific role. This information will be shared if an employment offer is extended.

Similar Jobs

More Jobs at Hark

More Information Technology Jobs

Find similar Data Engineering Lead jobs: