Prime Video is looking for a Research Engineer to support scientific research efforts in our Content Reasoning, Enrichment and Localization team. We build and deploy Generative AI models across Prime Video Lines of Business, including Derivative Content, Trust & Safety, and Metadata Localization. A Research Engineer supports Applied Scientists on the team by building experiment frameworks, infrastructure and deployment packages. A Research Engineer may be called to directly facilitate science benchmarking, model training, model deployment, and deep dive on any deep learning related technical problem. This person may be called to lead or facilitate a joint project between science and engineering team. This role would be responsible for end-to-end ownership of model training and deployment, from managing our GPU cluster, to monitoring job queues, and containerizing trained for deploying models into production. This role will support several research teams with remits across lines of business and machine learning methodologies.
Key job responsibilities
Cluster Management
* Architect and operate SLURM cluster infrastructure for distributed training and evaluation workloads
* Maintain healthy job status and manage queues from different users and teams
* Monitor feedback regarding cluster features and functions
* Identify and drive infrastructure optimization opportunities
* Develop self-service tooling, automation, and APIs
Model Deployment
* Gather requirements from collaborators on research teams
* Containerize Machine Learning Models
* Shepherd models through deployment into beta environments, including debugging builds
* Develop data collection, aggregation and monitoring pipelines
* Build observability and monitoring systems or dashboards for ML infrastructure
About the team
This team's mission is to deeply understand all content and empower customers with relevant language options, innovative accessibility assists, and rich title-information across all their content experiences on Prime Video. We delight our customers by pushing the boundaries of content understanding and enrichment. Through inclusion and innovation, we do the most fulfilling work of our career.
BASIC QUALIFICATIONS
- Experience in automating, deploying, and supporting large-scale infrastructure
- Experience programming with at least one modern language such as Python, Ruby, Golang, Java, C++, C#, Rust
- Experience with Linux/Unix
- Bachelor's degree, or 2+ years of working with Advanced Compute technologies including, but not limited to: Accelerated Compute, High Performance Compute, Visual/Spatial Compute, and/or IoT. experience
- 3+ years of cloud computing technologies experience
- Experience in developing and deploying LLMs in production on GPUs, Neuron, TPU or other AI acceleration hardware, or experience leading the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems
PREFERRED QUALIFICATIONS
- Experience with distributed systems at scale
- Master's degree
- Experience with large scale machine learning systems such as profiling and debugging and understanding of system performance and scalability
- Publications or contributions to open-source HPC projects
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, WA, SEATTLE - 129,200.00 - 174,800.00 USD annually
