5+ years of experience in data science or AI development
Strong understanding of AI models and their applications
Proficiency in designing evaluation metrics and analysis
Experience with workflow optimization and process mapping
Ability to collaborate with cross-functional teams
Responsibilities
Collaborate with operations experts to dissect workflows and determine AI integration
Design tailored AI solutions for various tasks, including predictive models and agent reasoning
Create evaluation sets and metrics to assess model performance
Conduct thorough analyses of pilot results to identify and rectify issues
Measure and report on time and cost efficiencies achieved through AI implementations
Develop reusable patterns from successful workflows for future projects
Benefits
Flexible work environment
Opportunities for professional development
Access to cutting-edge AI tools and technologies
Collaborative team culture
Impactful work that drives efficiency and innovation
Full Job Description
About the role
As Data Scientist in an AI Development pod you design the AI approach for each workflow and prove that it works. You shape the models, prompts and agent logic, and you own how we measure accuracy, quality and savings.
What you'll do
Work with operations experts to break a workflow into steps and decide where AI models, AI agents, rules or people should handle each one.
Design the right AI approach for each task, whether predictive models, LLM prompts and retrieval, or agent reasoning, and select the right models.
Build evaluation sets and metrics (accuracy, exception rates, review time) and run offline and online evaluations before and during pilots.
Analyze pilot results, find failure patterns and improve the solutions until they meet the targets to go live.
Measure the time and cost saved by each workflow and report results to the program team.
Package what works into reusable patterns for the next workflow.
