Position Overview: We are seeking a
Data Platform Engineer who combines expert-level data infrastructure skills with a
strong knowledge of AI & Machine Learning principles. In this role, you will go beyond simple data validation scripts; you will apply your understanding of model training dynamics to
design and implement existing and novel approaches to optimize our datasets. You will build and maintain large-scale image and video pipelines, but with a focus on
data curation strategies-such as coreset selection, embedding-based filtering, and automated complexity scoring. You'll partner closely with our ML engineers to orchestrate ingestion, synthetic data generation, and versioned releases, ensuring that every dataset is not only high-integrity and available but strictly optimized to maximize model performance.
What You'll Do: - Design and develop a scalable data infastructure, focusing on organization and curation to support continuing increases in data volume and complexity
- Design and implement existing and novel approaches to optimize datasets for model training (e.g., hard example mining, class balancing, de-duplication, embedded-based filtering).
- Support the data infrastructure required for optimal ingestion, transformation, and storing of datasets
- Develop and use synthetic data generation workflows to create realistic synthetic training data for computer vision models.
- Design and own end-to-end image and video pipelines for computer vision model training: multi-source ingestion, QA and visualization, standardization, and organization.
- Coordinate collection of real-world data; coordinate label creation and QA with labelers.
- Develop and use data quality tooling: metrics for balance, drift, and annotation error; active-learning sampling to target gaps; feedback loops from production back to curation.
- Implement and own dataset versioning, release management, and lineage and metadata cataloging.
What You'll Need: - 3+ years of experience in data engineering or equivalent fields.
- Solid understanding of data structures and systems design for orchestrating data-related workflows in a rapidly growing environment.
- Proficient in using AWS for data management and processing.
- Proficient in Python for scripting and data processing; proficient with SQL and Linux.
- Educational Background: Bachelor's or Master's degree in Computer Science or a related field.
- Proven ability to communicate well across engineering teams, and write and maintain effective documentation.
You'll Stand Out: - 5+ years of industry experience.
- Experience in image/video data engineering for computer vision projects.
- Experience with PyTorch DeepCore.
- Experience with Unreal Engine.
What We Offer: - Competitive salary
- ACS Equity Package
- Health, Dental, Vision Insurance
- Paid Time Off
