We are looking for a Technical Project Manager with expertise in managing and leading Responsible AI initiatives from inception to development, stakeholder management and risk mitigation skills.
Essential functions
- Own the planning, scheduling, execution, and delivery of high-volume data annotation projects. Translate model training data needs into structured project timelines and milestones.
- Implement project management methodologies (e.g., Agile, Scrum, Kanban) to track progress, unblock pipeline bottlenecks, and manage backlogs.
- Forecast resource needs, track operational budgets, and align data deliveries with the release cycles of the Data Science and ML Engineering teams.
- Proactively identify project risks (such as edge cases, delivery delays, or drop-offs in accuracy) and establish contingency plans.
- Serve as the primary point of contact for external Business Process Outsourcing (BPO) partners, labeling vendors, and global crowd-sourced workforces.
- Define, monitor, and enforce service-level agreements (SLAs) and key performance indicators (KPIs) regarding vendor throughput, speed, and cost efficiency.
- Lead the selection, negotiation, and onboarding processes for new data vendors to strategically scale operational capacity as company needs evolve.
- Collaborate with engineering teams to build and refine airtight, unambiguous annotation guidelines, taxonomies, and training materials.
- Design and enforce rigorous data auditing processes, measuring metrics like Inter-Annotator Agreement (IAA), consensus scores, and precision/recall of human labels.
- Evaluate and manage data labeling tools and platforms (e.g., Labelbox, Scale AI, CVAT, or custom internal interfaces) to maximize annotator efficiency.
Qualifications
- 4+ years of professional experience in Data Operations, Technical Project Management, or MLOps, with a heavy emphasis on handling AI/ML training data.
- Demonstrated track record of managing complex, cross-functional projects from inception to completion.
- Hands-on experience designing and executing text, image, video, audio, or multimodal data labeling workflows.
- Experience directly managing, communicating with, and auditing third-party vendors or offshore operations.
- Strong data tracking habits with the ability to build performance dashboards and parse metrics via Excel/Google Sheets or SQL.
- Advanced degree (MS/MBA) in a technical, organizational, or communication-related field.
Would be a plus
- Experience with advanced labeling workflows, such as RLHF (Reinforcement Learning from Human Feedback), red-teaming, or prompt-response evaluation for Large Language Models (LLMs).
- Basic understanding of Python or automation scripts to seamlessly move data across different systems and APIs.
- Experience working in a fast-paced, high-growth environment where workflows iterate rapidly.
We offer
- Opportunity to work on cutting-edge projects
- Work with a highly motivated and dedicated team
- Competitive salary
- Flexible schedule
- Benefits package - medical insurance, vision, dental, etc.
- Corporate social events
- Professional development opportunities
- Well-equipped office
Please note that all onboardings must occur in person and you may be asked to travel to attend.