Instacart

Senior Machine Learning Engineer II, Search & Recommendations Ranking

Instacart$173K — $253K *
US-AnywhereRemote in United States
Consumer Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years applying ML at scale, with 3+ years in technical leadership
  • Proven record improving ranking or recommendation systems in production
  • Experience in multi-objective optimization balancing relevance, revenue, and user experience
  • Strong coding skills in Python and data fluency with SQL/Pandas
  • Excellent analytical skills with strong cross-functional communication abilities

Responsibilities

  • Architect a comprehensive ranking backbone integrating query understanding and personalization
  • Design long-horizon objective functions to enhance user engagement and value
  • Develop production-grade Multi-Task Learning for relevance and churn risk assessment
  • Own and optimize the inference layer for real-time re-ranking and latency
  • Advance metrics and evaluation practices for tracking GTV and retention
  • Collaborate with cross-functional teams to translate business goals into actionable ranking policies
  • Mentor ML engineers to enhance expertise in ranking and causal inference

Benefits

  • Flexible remote work options with a focus on where employees feel most productive
  • Opportunities for team-matching exercises leading to well-suited role placement
  • Access to regular in-person events to foster community and connection among team members
  • Market-competitive compensation and benefits tailored to the worker's location
  • Eligibility for new hire equity grants and annual refresh grants
Full Job Description
Overview The Search & Personalization ML team is Instacart's engine for state-of-the-art multi-task, multi-objective ranking-unifying search, discovery, recommendation, ads, and merchandising into a single value-aware platform. Partnering with world-class engineers, scientists, and PMs, we build the ranking backbone that powers every pixel of the shopping journey, optimizing not just for clicks, but for incremental GTV, basket lift, and retention over the long run. What We're Building • Foundational Ranking Backbone Models: Multi-task/multi-objective models (shared encoders + task heads) that jointly learn relevance, conversion, margin contribution, churn risk, and ad quality, enabling consistent decisions across search and recommendations. • Value-Aware Optimization: Uplift and long-horizon value models that steer decisions toward incrementality and LTV, with calibrated constraints on quality, diversity, fairness, and spend pacing-plus guardrails for safe exploration. • LLM-Enhanced Retrieval & Features: Using LLMs to enrich query and item semantics for long-tail recall, generate features for cold-starts, and feed the ranker with reasoning-rich context, while remaining the source of truth for final ordering. Our commitment to AI innovation is reflected in our recent publications and research contributions to the field. About the Job • Architect the ranking backbone that unifies query understanding, personalization, multi-objective ranking, ads, and merchandising into a single adaptive platform. • Design and build a search autosuggest system optimized for personalization and value-based relevance. • Design long-horizon objective functions (e.g., incrementality, LTV, habit formation) and build uplift/causal value models that move beyond short-term engagement. • Develop production-grade Multi-Task Learning (e.g., shared encoders, MMOE/PLE task heads) to jointly learn relevance, propensity, margin, and churn risk-ensuring calibration, constraints, and explainability. • Own the inference layer: goal-aware re-rankers, diversity and quality constraints, safe exploration, and millisecond-class latency optimization. • Advance evaluation practices: online experiments, long-horizon cohort metrics, counterfactual evaluations, and attribution pipelines for tracking incremental GTV and retention. • Partner across ads, infrastructure, product, and design teams to translate business goals into ranking policies and measurable ROI. • Mentor ML engineers to build expertise in ranking, causal inference, and scalable serving systems. About You Minimum Qualifications • 5+ years applying ML at scale (3+ years in technical leadership), with a proven track record improving ranking or recommendation systems in production. • Demonstrated success in applying multi-objective or constrained optimization to balance relevance, revenue, margin, and user experience; experience with online testing and attribution beyond CTR. • Strong coding (Python) and data fluency (SQL/Pandas), with expertise in classic ML techniques (e.g., XGBoost) and deep learning frameworks (TensorFlow/PyTorch). • Excellent analytical skills and strong cross-functional communication abilities. Preferred Qualifications • Expertise in multi-task learning architectures (e.g., MMOE/PLE, shared encoders), calibration, counterfactual evaluation, uplift/causal modeling, and/or contextual bandits for exploration. • Experience building low-latency ranking services, including feature stores, caching, vector + lexical retrieval, re-ranking, and A/B testing infrastructure, with expertise in constraint-aware inference. • Hands-on experience with LLMs as feature/recall enhancers (e.g., embeddings, adapter tuning) while maintaining clarity on when the ranker should arbitrate. Instacart provides highly market-competitive compensation and benefits in each location where our employees work. This role is remote and the base pay range for a successful candidate is dependent on their permanent work location. Please review our Flex First remote work policy here. Offers may vary based on many factors, such as candidate experience and skills required for the role. Additionally, this role is eligible for a new hire equity grant as well as annual refresh grants. Please read more about our benefits offerings here. For US based candidates, the base pay ranges for a successful candidate are listed below. CA, NY, CT, NJ $207,000-$253,500 USD WA $198,000-$243,000 USD OR, DE, ME, MA, MD, NH, RI, VT, DC, PA, VA, CO, TX, IL, HI $190,000-$233,000 USD All other states $173,000-$212,000 USD

About Instacart

Instacart is an American company that operates a grocery delivery and pick-up service in the United States and Canada. The company offers its services via a website and mobile app. The service allows customers to order groceries from participating retailers with the shopping being done by a personal shopper. Instacart was founded in 2012 by entrepreneur Apoorva Mehta, a former Amazon.com employee. Apoorva was born in India and moved with his family to Canada in 2000. He studied engineering at the University of Waterloo and graduated in 2008. He was a participant in Y Combinator's Summer 2012 batch, which eventually led to the creation of Instacart. In 2013, Mehta was included on the Forbes 30 Under 30 list. Apoorva previously worked at BlackBerry, Qualcomm, and then Amazon as a supply chain engineer, where he developed fulfillment systems to move packages from Amazon's warehouses to customers' homes. Before founding Instacart, Apoorva had tried to start at least 20 other services. He tried building an ad network for social gaming companies, and developing a social network specifically for lawyers, among other start-ups. Instacart originally launched in San Francisco. By April 2015, the firm had about 200 employees. It introduced a new policy around June allowing some shoppers to choose to be part-time employees, starting with Chicago and Boston and extending its offer to shoppers in Atlanta, Miami, and Washington D.C. the following month.
Learn more about Instacart
Industry
Founded
2012

Similar Jobs

More Jobs at Instacart

More Consumer Technology Jobs

Find similar Senior Machine Learning Engineer II, Search & Recommendations Ranking jobs: