Key job responsibilities
Work hands-on with complex, noisy datasets to derive actionable insights and explain/debug black-box models using interpretability and data-attribution methods (e.g., SHAP/TreeSHAP, Anchors, Integrated Gradients, counterfactuals, nearest-neighbor exemplars, influence/data attribution).
Design and analyze experiments and observational studies with rigorous statistical inference, including confidence intervals, power/sample-size estimation, variance reduction, and appropriate tests (e.g., two-sample tests, permutation tests, sequential testing, and multiple-comparison control such as FDR).
Benchmark models and datasets using classical and modern techniques; select ML methods based on data and operational constraints (e.g., clustering/KDE, tree ensembles, CNN/RNN/Transformers, representation learning), and evaluate with robust metrics and diagnostics (e.g., AUROC, AUPRG, proper scoring rules/losses, calibration/ECE, threshold/utility curves, slice-based evaluation, and error analysis).
Apply production-grade measurement and MLOps practices, including data quality monitoring, drift/shift detection (PSI, KS, MMD/embedding drift), and A/B test design and readouts with disciplined diagnosis of metric movement (e.g., instrumentation changes, seasonality, novelty effects, sample-ratio mismatch, guardrail tradeoffs).
Deliver end-to-end analyses that improve team execution and decision-making-define goal-driving metrics with stakeholders, build clear reporting (tables, dashboards, and visualizations), and communicate results that translate into concrete actions.
Investigate anomalies and data integrity issues across diverse data sources using structured root-cause analysis, correlation diagnostics, significance testing, and simulation across high- and low-fidelity datasets.
Partner closely with cross-functional domain experts to design experiments and interpret results, applying modern statistical methods to evaluate predictive and generative models as well as operational and process performance.
Develop production-quality analytics and modeling code-write well-tested, maintainable SQL/Python scripts and analysis workflows that can be promoted into production pipelines, and continuously adopt new statistical methods and best practices as the field evolves.
A day in the life
New data has just landed and promoted to our datalake. You load the data and verify it's overall integrity by visualizing variation across target subsets. You realize we may have made progress toward our goals and begin to test the validity of your nominal results. At midday you grab lunch with new coworkers and learn about their fields or weird interests (there are many). You generate visualizations for the entire dataset and perform significance tests that reinforce specific findings. You meet with peers in the afternoon to discuss your findings and breakdown the remaining tasks to finalize your group report!
About the team
Innovators wanted! Are you an entrepreneur? A builder? A dreamer? This role is part of an Amazon Special Projects team that takes the company's Think Big leadership principle to the limits. We focus on creating entirely new products and services with a goal of positively impacting the lives of our customers. No industries or subject areas are out of bounds. If you're interested in innovating at scale to address big challenges in the world, this is the team for you.
BASIC QUALIFICATIONS
- 5+ years of data querying languages (e.g. SQL), scripting languages (e.g. Python) or statistical/mathematical software (e.g. R, SAS, Matlab, etc.) experience
- Master's degree in Science, Technology, Engineering, or Mathematics (STEM), or experience working in Science, Technology, Engineering, or Mathematics (STEM)
- Experience in applying statistical models for large-scale application and building automated analytical systems
PREFERRED QUALIFICATIONS
- PhD in Science, Technology, Engineering, or Mathematics (STEM)
- Knowledge of machine learning approaches and algorithms
- Experience in a ML or data scientist role with a large technology company
- 5+ years of working with Data & AI related technologies, including, but not limited to, AI/ML, GenAI, Analytics, Database, and/or Storage experience
- Experience working on multi-team, cross-disciplinary projects
- Experience applying quantitative analysis to solve business problems and making data-driven business decisions
- Experience effectively communicating complex concepts through written and verbal communication
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, WA, Seattle - 159,200.00 - 215,300.00 USD annually
