As a Senior ML Scientist at Ada, you will own the quality and reliability of the AI features that power our AI Agent platform for customer support. You will partner with Product Managers, Engineers, and Designers to frame problems, design experiments, and make evidence-based decisions that improve outcomes for customers and end users. You will primarily deliver simple and highly reusable evaluation and analysis code, and you will collaborate with engineers to productionize changes. To be successful, you will develop a deep understanding of Ada's product and empathize with our users to find the best ways to solve customer problems. If you're excited to shape the future of AI-driven customer support, we would love to hear from you. About You • 5+ years of industry experience as a Data Scientist, Machine Learning Engineer, or similar with shipped work that moved product metrics • Deep experience applying large language models to customer problems • Excellent communicator, able to explain experimental results and complex ML concepts to diverse audiences • You design reliable experiments and datasets that translate to production impact • Strong software skills in Python, writing clean, production-ready code and documents Outcomes • Run rapid, reliable experiments with sound statistical methods, reproducible pipelines, and clear readouts that drive product decisions • Lead design choices across model selection, retrieval and grounding, prompting, and tool use, framing tradeoffs in quality, safety, cost, and latency • Reduce critical AI failure modes, for example hallucinations and prompt injection, through targeted testing and red teaming • Partner with PM, Engineering, and Design to prioritize customer use cases and failure modes, turning insights into changes that improve automated resolutions, CSAT, cost per conversation, and latency • Coach and mentor peers in the Product Development org in AI feature design, experimentation, and measurement. Provide crisp and actionable feedback to help raise the standard for AI feature quality Benefits & Perks At Ada, you'll not only build extraordinary products but also thrive in an environment designed for your success. We prioritize your well-being, growth, and work-life balance. Here's what we offer: Benefits • Unlimited Vacation: Recharge when you need to. • Comprehensive Benefits: Extended health coverage, dental, vision, travel, and life insurance. • Wellness Account: Empowering you to invest in your overall well-being and lifestyle. • Employee & Family Assistance Plan: Resources to support you and your loved ones. Perks • Flexible Work Schedule: Balance your work and personal life. • Remote-First, In-Person Friendly: Options to work from home or at our local hub. • Learning & Development Budget: Invest in your long-term growth goals and skills. • Work from Home Budget: Equipping you with the tools and support for a seamless remote work experience. • Access to Cutting-Edge AI Tools: Work with the best AI tech stack in the industry. • Hands-On with LLMs: Enhance your expertise in leveraging large language models. • A Thriving Industry: Join the forefront of innovation in AI, shaping the future of technology. The above Benefits and Perks only apply to full-time, permanent employees.