Senior Data Platform Engineer

FieldAI

$135K — $160K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of experience in building production data platforms or large-scale data-processing systems
  • Proficient in programming languages such as Python, C++, Java, or Go
  • Familiarity with distributed data processing and workflow orchestration
  • Experience with data lakes, object storage, and versioning systems
  • Strong grasp of data quality, lineage, and pipeline reliability
  • Knowledge of tools like S3, Airflow/Dagster, Spark/Ray, and Kubernetes
  • Excellent at navigating ambiguous technical environments

Responsibilities

  • Design and build scalable data architecture for robotics and ML datasets
  • Create services for data ingestion, processing, and quality management
  • Develop reliable pipelines for transforming raw robot data into usable ML products
  • Define data models and workflows for processing life cycles
  • Track data provenance and lineage for ML workflows
  • Implement automated validation frameworks for data quality
  • Enhance observability across complex data processing workflows
  • Collaborate with ML and robotics teams on specific data requirements

Benefits

  • Collaborative environment with cross-functional teamwork
  • Opportunity to work on cutting-edge autonomous robotics technology
  • Potential for professional growth and skill development
  • Access to large-scale data sets for innovative problem-solving
  • Engagement with leading experts in the fields of ML and robotics
Full Job Description
About the Role

We are building the data foundation that powers the full machine learning lifecycle for autonomous robotics. Our robots generate large-scale, multimodal datasets across real-world deployments, and turning that raw experience into reliable, discoverable, high-quality ML data is a core part of improving our autonomy systems.

As a Data Platform Engineer, you will help design and build the platform that manages data from ingestion through processing, validation, labeling, dataset generation, training, and evaluation.

This is not a traditional analytics data engineering role. You will work closely with ML engineers, researchers, labeling teams, robotics engineers, and infrastructure engineers to build scalable systems for robotics and ML data.

What You'll Do

  • Design and build scalable data architecture for large-scale multimodal robotics and ML datasets.
  • Build abstractions and services for ingestion, processing, datasets, metadata, lineage, and data quality.
  • Develop reliable pipelines for transforming raw robot data into versioned, ML-ready data products.
  • Define data models, schemas, contracts, and lifecycle states across data-processing workflows.
  • Build systems for tracking provenance and lineage across raw data, derived artifacts, labels, datasets, and downstream ML workloads.
  • Develop automated validation and data-quality frameworks that detect incomplete, corrupted, or unusable data early.
  • Design for incremental processing, reprocessing, backfills, and versioned transformations.
  • Improve observability and failure diagnosis across complex data workflows.
  • Partner with ML and robotics teams to understand domain-specific data requirements and turn recurring patterns into reusable platform capabilities.
  • Work closely with infrastructure/platform teams on storage, compute, orchestration, reliability, and scalability.


What We're Looking For

  • Strong experience building production data platforms or large-scale data-processing systems.
  • Strong software engineering skills, preferably Python and/or C++/Java/Go.
  • Experience with distributed data processing and workflow orchestration.
  • Experience with data lakes/lakehouses, object storage, metadata systems, schemas, and data versioning.
  • Strong understanding of data quality, lineage, reproducibility, and reliable pipeline design.
  • Experience with technologies such as S3, Airflow/Dagster, Spark/Ray, Kubernetes, Parquet, or similar systems.
  • Ability to work across ambiguous organizational and technical boundaries.
  • Strong systems-design and engineering judgment.


Nice to Have

  • Experience with ML datasets or ML infrastructure.
  • Robotics, autonomous vehicles, sensor, video, image, LiDAR, or other multimodal data.
  • Experience building internal developer/platform products.
  • Experience operating pipelines at TB/PB scale.


Our salary range is generous and we consider each individual's background and experience when determining final compensation. Base pay may vary based on role scope, job-related knowledge, skills, experience, and the Irvine, California market.

Similar Jobs

More Jobs at FieldAI

More Information Technology Jobs

Find similar Senior Data Platform Engineer jobs: