About the RoleAs a Machine Learning Engineer at Sieve, you'll own the entire ML lifecycle - from understanding customer problems, to designing datasets, improving models, building evaluation systems, and shipping production pipelines that deliver measurable improvements in dataset quality.
You'll work directly with frontier AI labs to understand difficult data problems, then build end-to-end systems that solve them. One week you might fine-tune a multimodal model to improve recall on a difficult edge case. The next you might engineer a VLM-based QA pipeline, design a new evaluation framework, or run a large-scale filtering pipeline on millions of hours of multimodal data.
We're looking for engineers who enjoy owning problems end-to-end, from understanding customer requirements through shipping production ML systems that measurably improve dataset quality.
What You'll Do- Own model quality for customer-facing video understanding problems
- Fine-tune vision-language and multimodal foundation models for specialized tasks
- Build automated evaluation and QA pipelines using frontier models like Gemini, GPT, Claude, and open-source VLMs
- Design high-precision filtering, ranking, retrieval, and labeling systems over internet-scale video datasets
- Create datasets, benchmarks, and evaluation frameworks that continuously improve model quality
- Develop production ML pipelines spanning preprocessing, inference, post-processing, and quality validation
- Work directly with frontier AI labs to translate ambiguous requirements into scalable ML systems
- Ship improvements quickly, measure results, and iterate based on real-world performance
Requirements- Strong Python engineer with experience building production ML systems
- Experience training, fine-tuning, or deploying modern deep learning models
- Comfortable working with PyTorch and modern foundation models
- Excellent intuition for evaluation, dataset quality, precision/recall tradeoffs, and edge cases
- Enjoys rapidly prototyping with new AI models and APIs
- Comfortable owning projects from customer problem to internal pipelines to deployed solution
- Strong communicator who enjoys working directly with customers and cross-functional teams
- Excited by video, multimodal AI, and frontier foundation models
- In-person at our SF HQ
*all roles at Sieve require you to be onsite in San Francisco 5 days per week