As a Software Dev Engineer on the Evaluations & Optimization team, you will build state-of-the-art systems that help customers assess the quality, performance, and reliability of Agents and build state of the art solutions for agents optimization. You will define and deliver foundational infrastructure and developer tooling that powers evaluation workflows for some of the world's most advanced GenAI and Agentic systems.
Our work spans deep learning, large-scale distributed systems, and evaluation science workflows. We work closely with applied scientists, product managers, and UX designers to deliver services that are robust, extensible, and easy to use for developers and enterprise customers alike.
Key job responsibilities
• Design and implement core runtime infrastructure components including control plane APIs, data plane execution environments, and deployment orchestration systems
• Develop monitoring, observability, and operational tooling to ensure production reliability and enable rapid incident response
• Collaborate with AWS Lambda, Bedrock, and open-source framework teams (LangChain, LangGraph, Strands) to integrate and optimize agent capabilities
• Contribute to technical strategy and architecture decisions for session management, identity/permissions, cross-account access, and security integrations
BASIC QUALIFICATIONS
- 1+ years of non-internship professional software development experience
- Experience programming with at least one software programming language
PREFERRED QUALIFICATIONS
- Bachelor's degree in computer science or equivalent
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, WA, Seattle - 143,700.00 - 194,400.00 USD annually