Apple

AIML - Distinguished Engineer, Foundation Model

Apple • $210K — $250K *
Consumer Technology
11 - 15 years of experience
Job Overview by Ladders

Qualifications

  • MS or PhD in Computer Science, Machine Learning, or related field, or equivalent experience.
  • 15+ years in building large-scale ML or distributed systems with significant technical leadership impact.
  • Hands-on expertise in foundation model inference engines focused on performance and reliability.
  • Experience supporting varied foundation model inference use cases with different constraints.
  • Knowledge in adjacent systems areas like training infrastructure or data systems.
  • Deep understanding of GPU/TPU architectures, distributed systems, and model optimization techniques.
  • Proficient with ML frameworks (e.g., JAX, PyTorch) and serving stacks.

Responsibilities

  • Set the technical direction for the inference engine and its supporting systems.
  • Partner with modeling and research teams to integrate new capabilities into the development loop.
  • Lead diverse engineering teams to turn ambitious vision into reality by hitting milestones.
  • Shape and expand technical strategies beyond inference into adjacent domains like training and evaluation.
  • Own the performance and reliability of the inference engine for the foundation model team.
  • Collaborate with teams having varied requirements to ensure seamless systems integration.
  • Mentor junior and senior engineers, fostering a culture of technical excellence.

Benefits

  • Opportunity to lead pioneering technology initiatives at Apple.
  • Work closely with top-tier ML researchers and engineers.
  • Be a central figure in shaping the future of foundation models.
  • Collaborative environment with diverse internal teams.
  • Influence the strategic direction of cutting-edge machine learning systems.
Full Job Description
We are seeking a Distinguished Engineer to set the technical direction for the

systems that power our foundation model training - with an initial focus on the

inference engine that the foundation model team relies on for training, model

evaluation, and other needs in the model development loop.

This is a senior individual-contributor leadership role. You will be one of the

most senior technical voices for foundation model systems at Apple: defining

the vision, driving execution across many teams, and raising the bar for

engineering excellence. The role starts with the inference engine, but we

expect you to move fluidly into adjacent training systems areas as the needs of

the foundation model program evolve.

Description

engineered specifically for Apple silicon and for experiences that are private,

personal, and deeply integrated into the OS. Behind that modeling work sits a

demanding systems layer, and the inference engine is at its center.

Our inference engine is used by the foundation model team throughout the model

development lifecycle: generating and processing data and running rollouts for

training, powering large-scale model evaluation, and serving as an LLM judge

that scores and compares model outputs. These workloads are high throughput,

bursty, and tightly coupled to research iteration - the speed, efficiency, and

reliability of the engine directly set the pace at which the team can train and

improve models.

As a Distinguished Engineer, you will own the technical strategy for this

inference engine and the broader systems that support it. You will partner

closely with modeling and research teams to bring new capabilities into the

development loop, work across many internal teams with very different

requirements, and lead a diverse set of engineers in turning an ambitious

vision into shipped milestones. While inference is the initial focus, you will

also help shape adjacent areas - training infrastructure, data systems, and

evaluation. If you are drawn to hard systems problems where the research and

the infrastructure are inseparable, this is the role.

Minimum Qualifications

MS or PhD in Computer Science, Machine Learning, or related technical field,

or equivalent industry experience.

15+ years of experience building large-scale ML or distributed systems, with

a track record of technical leadership and industry-wide or company-wide

impact.

Deep, hands-on expertise in foundation model inference engines, with a proven

record of improving performance, efficiency, and reliability at scale.

Deep experience supporting a diverse set of foundation model inference use

cases, each with different throughput, latency, cost, and quality constraints.

Breadth beyond inference - the ability to contribute in adjacent systems areas

such as training infrastructure, data systems, or evaluation.

Deep understanding of GPU/TPU/accelerator architecture, distributed systems, and

model optimization (quantization, distillation, compilation, serving).

Proficiency with ML frameworks such as JAX, PyTorch, and with

inference/serving stacks.

Proven experience leading a diverse set of engineers in setting vision and

driving execution, including prioritization for milestone deliveries.

Demonstrated experience mentoring junior and senior engineers.

Demonstrated experience partnering with ML researchers and modeling teams to

productionize research.

Preferred Qualifications

Experience building or leading inference systems for large language models and

multi-modal foundation models at scale.

Experience with inference in training, evaluation, or reinforcement-learning

loops (e.g., large-scale rollouts, offline eval, or LLM-as-judge / reward

scoring).

Familiarity with Kubernetes, Docker, and cloud platforms (AWS, GCP, Azure),

and with distributed computing frameworks.

History of defining technical strategy that shaped an organization's or the

industry's direction.

About Apple

Apple is a corporation that designs, manufactures, and markets mobile communication and media devices, personal computers, portable digital music players, and sells a variety of related software, services, peripherals, networking solutions, and third-party digital content and applications. Apple provides many products and services, including iPhone; iPad; iPod; Mac; Apple TV; a portfolio of consumer and professional software applications; the iOS and OS X operating systems; iCloud; and accessories, service, and support offerings. It sells its products worldwide through its retail stores, online stores, direct sales force and third-party cellular network carriers, wholesalers, retailers, and value-added resellers to the consumer and also sells third-party iPhone, iPad, Mac and iPod compatible products, including application software and accessories through its online and retail stores. Introduced in 1984, the Macintosh was the first widely sold personal computer with a graphical user interface (GUI). That feature and others such as an improved floppy drive design and a low-cost hard drive that made data retrieval faster helped Apple cultivate a reputation for innovation. Apple was named as the most admired company in the United States in 2008 and in the world from 2008 to 2012 by the Fortune magazine. The company was founded by Steven Paul Jobs, Steve Wozniak, and Ronald Gerald Wayne on April 1, 1976, and is headquartered in Cupertino, California.

Apple Careers

Join Apple, a place where extraordinary people gather to do their best work. Our ever-expanding global team is at the forefront of innovation and leadership in the tech industry. At Apple, we're not just building products—we're crafting the kind of wonder that revolutionizes entire industries. It's the diversity of our people and their ideas that inspires the innovation that runs through everything we do, from amazing technology to industry-leading environmental efforts. Work You’ll Do Embark on a journey with Apple’s market-leading team to help some of the world’s most influential companies navigate their path to digital mastery with cutting-edge technology and services. Transform industries and touch lives with your unique ideas at Apple. Here, you’ll lead through a unique position at the intersection of technology, creativity, and robust industry expertise. Collaborate with a global team of professionals who are at the top of their game in technology and design. Apple isn’t just a company, it’s a community of innovators and passionate thinkers. Introducing the Apple Innovation and Leadership Initiative We are building a market-leading team to drive our efforts in delivering groundbreaking solutions and services. At Apple, job opportunities are abundant, offering you the chance to explore diverse roles from engineering to marketing, all designed to empower your career growth. Do Innovative Work Join the largest group of creative and technical experts in the world—professionals dedicated to redefining what’s possible through technology and innovation. Deliver targeted solutions through a depth and breadth of expertise that’s unmatched, driving forward our commitment to excellence and leadership in every project we undertake. Be Part of a Great Team Engage in a wide range of projects utilizing Apple’s technology and resources. Harness the unparalleled capabilities, global scale, and joint solution development that only Apple can offer. Future-Proof Your Career Advance your career with limitless opportunities at Apple. Go as far as your ambition takes you with unmatched training, development, and certification support. Explore Discover how Apple is leading the way in tech innovation: [With iOS] Businesses can streamline operations and enhance customer interactions... READ MORE Smart home technology integration that sets the standard for convenience and security... READ MORE The Apple Experience Our combined service capabilities, global scale, and joint solution development help clients overcome challenges and lead transformation in their industries. Clients worldwide look to Apple for new strategies and solutions that drive growth and innovation in the digital era. Stay Connected Join Our Team Search open positions that match your skills and interests. We look for passionate, curious, creative, and solution-driven team players. Whether you’re seeking a professional role, an internship, or a leadership position, Apple offers a variety of employment opportunities. SEARCH APPLE JOBS Keep Up to Date Stay ahead with career tips, insider perspectives, and industry-leading insights you can put to use today—all from the people who work here. READ CAREERS BLOG Job Alert Emails Personalize your subscription to receive job alerts, latest news, and insider tips tailored to your preferences. See what exciting and rewarding opportunities await at Apple, a company committed to diversity, innovation, and leadership. Explore job opportunities, employment benefits, and the culture of growth and innovation at Apple. Prepare your resume, hone your interview skills, and ready yourself for a career at one of the most prestigious companies in the world. Join us in pushing the boundaries of what is possible.
Learn more about Apple
Size
154,000 employees
Market Cap
$2,074.3 billion
Industry
Net Income
$63.9 billion
Founded
1976
5 Year Trend
+11.5%
Revenue
$294.1 billion
NASDAQ

Similar Jobs

More Jobs at Apple

More Consumer Technology Jobs

Find similar AIML - Distinguished Engineer, Foundation Model jobs: