In this role, you will design and develop benchmark and evaluation frameworks to assess Large Language Model (LLM) capabilities, with a specific focus on e-commerce and shopping applications. You will utilize these frameworks to curate high-quality training data that enhances model performance in shopping-related tasks. Experience with LLM benchmarking, evaluation methods, and applied reinforcement learning is preferred. You'll be working with talented scientists, engineers, and technical program managers (TPM) to innovate on behalf of our customers.
BASIC QUALIFICATIONS
- 3+ years of building models for business application experience
- PhD, or Master's degree and 4+ years of CS, CE, ML or related field experience
- Experience in patents or publications at top-tier peer-reviewed conferences or journals
- Experience programming in Java, C++, Python or related language
- Experience in any of the following areas: algorithms and data structures, parsing, numerical optimization, data mining, parallel and distributed computing, high-performance computing
PREFERRED QUALIFICATIONS
- Experience using Unix/Linux
- Experience in professional software development
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, CA, Palo Alto - 171,600.00 - 222,200.00 USD annually