Apple

Machine Learning Engineer, ML/GenAI Evaluation

Apple • $120K — $160K *
Austin, TX 78745In-Person
Finance & Insurance
5 - 7 years of experience
Today
Be an Early Applicant
Job Overview by Ladders

Qualifications

  • M.S. in Machine Learning, Statistics, or related field preferred; Bachelor's with 7+ years in ML evaluation considered.
  • 5+ years of hands-on experience in model evaluation and offline metrics design.
  • Strong track record in designing comprehensive evaluation frameworks for production ML systems.
  • Creative in translating ML metrics into user trust measures.
  • Experience with testing for model behavior under various distribution shifts.
  • Strong programming skills in Python and familiarity with evaluation tools like MLflow or W&B.
  • Excellent communication skills for conveying technical results to diverse audiences.

Responsibilities

  • Establish evaluation criteria and quality standards for ML models across Wallet features.
  • Design test frameworks and adversarial test strategies to assess model robustness.
  • Collaborate with cross-functional teams on model quality and deployment decisions.
  • Own the evaluation lifecycle and make final quality calls on models before release.
  • Surface failure modes and ensure high standards of accuracy and fairness in models.
  • Shape model development priorities based on evaluation findings.
  • Influence product decisions at scale through rigorous ML evaluation processes.

Benefits

  • Opportunity to work at the intersection of ML science and high-impact product decisions.
  • Collaborative work environment with cross-functional teams.
  • Impactful contribution to AI technologies used by hundreds of millions of users.
  • Access to cutting-edge evaluation tools and frameworks.
  • Chance to shape industry standards in ML evaluation and model quality.
Full Job Description
Machine Learning Engineer, ML/GenAI Evaluation
Would you like to contribute to Machine Learning and Generative AI technologies? Are you passionate about measuring what matters and ensuring AI systems work reliably for everyone? Do you believe that rigorous evaluation - including holding models accountable to fairness standards - is what separates great ML from good ML? We truly believe it is!\n\nWe are defining what exceptional looks like for machine learning across Wallet, Payments, and Commerce. As a Machine Learning Engineer specializing in Evaluation, you will establish the evaluation criteria, metrics frameworks, and quality standards that determine when models are ready to reach hundreds of millions of users. Your judgment shapes model quality and earns the confidence to ship.\n\nYou\'ll work at the intersection of rigorous ML science and high-impact product decisions, collaborating closely with ML Engineering, Product, Privacy, and Legal teams. This unique opportunity puts you at the center of model quality - designing adversarial test strategies, surfacing failure modes before they reach users, and owning the sign-off process that ensures Apple\'s financial features meet the highest bar for accuracy, robustness, and reliability.\n

The ideal candidate is a rigorous, curious ML practitioner who believes that how you measure a model is just as important as how you train it. You think critically about what metrics actually capture, know how models break in the real world, and hold quality standards others find uncomfortably high - including on dimensions like fairness. You will own the full evaluation lifecycle for ML models across Wallet features - designing test frameworks, adversarial corpora, and benchmarks that reflect the diversity of Apple\'s global user base, then making the final quality call before any model ships. Your findings directly shape model development priorities and product decisions at scale.

M.S. in Machine Learning, Computer Science, Statistics, Applied Mathematics, or a related technical field strongly preferred. Bachelor\'s degree with 7+ years hands-on experience in ML evaluation, model quality, or applied research will be considered 5+ years of hands-on ML experience, with deep expertise in model evaluation, offline metrics design, and behavioral testing Strong track record designing evaluation frameworks for production ML systems - not just accuracy/F1, but precision-recall tradeoffs, calibration, fairness, and task-specific quality dimensions Creative mindset with the ability to translate standard ML evaluation metrics (F1, AUC, etc.) into utility and user trust measures Experience testing for distribution shift, out-of-distribution generalization, and temporal drift in real-world deployed models Proven ability to construct adversarial test suites, aggressor scenarios, and edge-case corpora that surface model failure modes before they reach users Experience with structured and semi-structured document understanding, OCR pipelines, or financial data extraction is a strong plus Strong programming skills in Python; fluency with evaluation tooling, data pipelines, and experiment tracking (e.g., MLflow, W&B, or equivalent) Excellent communication skills - ability to translate metric results into product-quality narratives for engineering and executive audiences Experience owning model quality sign-off in a cross-functional launch process

PhD in Computer Science, Data Science, Statistics, AI/ML, or a related field. Experience with Bayesian or causal graph-based approaches to data generation. Experience with causal approaches to fairness evaluation - counterfactual fairness, causal Shapley values, or structural causal model-based bias auditing. Experience evaluating models under privacy constraints or on-device inference settings is a plus. Familiarity with confidence calibration techniques and uncertainty quantification a plus Background in financial services, fintech, or consumer payment products

About Apple

Apple is a corporation that designs, manufactures, and markets mobile communication and media devices, personal computers, portable digital music players, and sells a variety of related software, services, peripherals, networking solutions, and third-party digital content and applications. Apple provides many products and services, including iPhone; iPad; iPod; Mac; Apple TV; a portfolio of consumer and professional software applications; the iOS and OS X operating systems; iCloud; and accessories, service, and support offerings. It sells its products worldwide through its retail stores, online stores, direct sales force and third-party cellular network carriers, wholesalers, retailers, and value-added resellers to the consumer and also sells third-party iPhone, iPad, Mac and iPod compatible products, including application software and accessories through its online and retail stores. Introduced in 1984, the Macintosh was the first widely sold personal computer with a graphical user interface (GUI). That feature and others such as an improved floppy drive design and a low-cost hard drive that made data retrieval faster helped Apple cultivate a reputation for innovation. Apple was named as the most admired company in the United States in 2008 and in the world from 2008 to 2012 by the Fortune magazine. The company was founded by Steven Paul Jobs, Steve Wozniak, and Ronald Gerald Wayne on April 1, 1976, and is headquartered in Cupertino, California.

Apple Careers

Join Apple, a place where extraordinary people gather to do their best work. Our ever-expanding global team is at the forefront of innovation and leadership in the tech industry. At Apple, we're not just building products—we're crafting the kind of wonder that revolutionizes entire industries. It's the diversity of our people and their ideas that inspires the innovation that runs through everything we do, from amazing technology to industry-leading environmental efforts. Work You’ll Do Embark on a journey with Apple’s market-leading team to help some of the world’s most influential companies navigate their path to digital mastery with cutting-edge technology and services. Transform industries and touch lives with your unique ideas at Apple. Here, you’ll lead through a unique position at the intersection of technology, creativity, and robust industry expertise. Collaborate with a global team of professionals who are at the top of their game in technology and design. Apple isn’t just a company, it’s a community of innovators and passionate thinkers. Introducing the Apple Innovation and Leadership Initiative We are building a market-leading team to drive our efforts in delivering groundbreaking solutions and services. At Apple, job opportunities are abundant, offering you the chance to explore diverse roles from engineering to marketing, all designed to empower your career growth. Do Innovative Work Join the largest group of creative and technical experts in the world—professionals dedicated to redefining what’s possible through technology and innovation. Deliver targeted solutions through a depth and breadth of expertise that’s unmatched, driving forward our commitment to excellence and leadership in every project we undertake. Be Part of a Great Team Engage in a wide range of projects utilizing Apple’s technology and resources. Harness the unparalleled capabilities, global scale, and joint solution development that only Apple can offer. Future-Proof Your Career Advance your career with limitless opportunities at Apple. Go as far as your ambition takes you with unmatched training, development, and certification support. Explore Discover how Apple is leading the way in tech innovation: [With iOS] Businesses can streamline operations and enhance customer interactions... READ MORE Smart home technology integration that sets the standard for convenience and security... READ MORE The Apple Experience Our combined service capabilities, global scale, and joint solution development help clients overcome challenges and lead transformation in their industries. Clients worldwide look to Apple for new strategies and solutions that drive growth and innovation in the digital era. Stay Connected Join Our Team Search open positions that match your skills and interests. We look for passionate, curious, creative, and solution-driven team players. Whether you’re seeking a professional role, an internship, or a leadership position, Apple offers a variety of employment opportunities. SEARCH APPLE JOBS Keep Up to Date Stay ahead with career tips, insider perspectives, and industry-leading insights you can put to use today—all from the people who work here. READ CAREERS BLOG Job Alert Emails Personalize your subscription to receive job alerts, latest news, and insider tips tailored to your preferences. See what exciting and rewarding opportunities await at Apple, a company committed to diversity, innovation, and leadership. Explore job opportunities, employment benefits, and the culture of growth and innovation at Apple. Prepare your resume, hone your interview skills, and ready yourself for a career at one of the most prestigious companies in the world. Join us in pushing the boundaries of what is possible.
Learn more about Apple
Size
154,000 employees
Market Cap
$2,074.3 billion
Industry
Enterprise Technology
Net Income
$63.9 billion
Founded
1976
5 Year Trend
+11.5%
Revenue
$294.1 billion
NASDAQ
AAPL
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at Apple

More Finance & Insurance Jobs

Find similar Machine Learning Engineer, ML/GenAI Evaluation jobs:

NationwideAustin, TX