Apple

ML Software Engineer

Apple$130K — $155K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science, Computer Engineering, or related field, or equivalent experience.
  • 2+ years experience in building large-scale distributed systems for ML inference.
  • Experience reasoning about latency and throughput trade-offs in a performance-centric context.
  • Proficiency in a systems programming language (e.g., Python, Go, Rust, Java, C++, etc.).
  • Familiarity with observability metrics, logs, and debugging in production environments.

Responsibilities

  • Engineer improvements in performance and stability for Private Cloud Compute.
  • Integrate new ML functionalities emerging from research into the existing stack.
  • Support deployment of inference stack on new SoCs and hardware accelerations across platforms.
  • Write scalable frameworks that coordinate ML inference across different SoC acceleration IP blocks.
  • Ensure reliable and performant service stack integration for user traffic handling.

Benefits

  • Collaborative team environment with a focus on excellence.
  • Opportunity to work at the cutting edge of generative AI and cloud technology.
  • Chance to collaborate with various teams within Apple, including hardware and product.
  • Emphasis on continuous learning and applying new research to practical solutions.
  • Access to Apple’s resources and innovative platforms.
Full Job Description
Our team builds the ML-inference stack that powers generative AI for Apple Intelligence's Private Cloud Compute - running on Apple Silicon in the datacenter, distributing work across on-SoC acceleration hardware and multi-node clusters. Built on Private Cloud Compute's privacy guarantees, we're growing the team to scale across more platforms and support a widening set of features.

Description

As part of the team you will help engineer continuous improvements in stability and performance for Private Cloud Compute, help implement entirely new functionality as it emerges from the research community, and help bring our inference stack up on new generations of SoCs and hardware acceleration IP as we extend to more platforms - in collaboration with hardware, product and research teams throughout Apple.

We write performant and scalable frameworks (primarily in Swift, with C++ where we bridge to the hardware) to distribute and coordinate ML inference across the acceleration IP blocks of different SoCs, and to move data and coordinate work reliably across multi-node inference clusters. You will integrate inference code into a full service stack so that user traffic is served reliably and performantly, with a strong focus on code that is easy and safe to develop, update, and monitor in production.

We're a collection of highly skilled and friendly engineers who value each other's opinions and experience. We strive for excellence and believe strongly in the quality of our output. We are a team of domain experts, each specializing in specific core subject areas, with broad collective experience across cloud software services and platforms.

Minimum Qualifications

2 Years practical experience plus Bachelor's degree in Computer Science, Computer Engineering, or a related field - or equivalent practical experience.

Experience building large-scale distributed systems that serve ML inference, reasoning across processes, hosts, and service tiers as well as model behavior under load.

A ML performance-centric mindset - able to reason about latency/throughput trade-offs and to distinguish what can be solved at the system level from what requires model-system co-design.

Strong in a systems or server language - Python, Go, Rust, Java, C++, or similar. Swift is what we write, but we don't expect it going in.

Preferred Qualifications

Low-level or close-to-the-metal work - systems programming, performance, or hardware/SoC bring-up.

Server-side Swift, or RPC/networking stacks (gRPC, Protocol Buffers).

Strong debugging and observability instincts - fluent in logs, metrics, and traces, with observability-stack (OpenTelemetry, Splunk), SLO/error-budget, and on-call experience, and able to drive a production incident to root cause.

Depth in ML inference serving optimizations - quantization, sparsity, batching, KV cache, tokenization, GPU acceleration - enough to optimize the system and reason about the trade-offs and requirements it places on models (you won't be training them).

Solid grasp of concurrency, async/streaming, resource lifecycle, and error/cancellation handling; bonus for Apple platform experience (XPC, Instruments, Swift Concurrency).

About Apple

Apple is a corporation that designs, manufactures, and markets mobile communication and media devices, personal computers, portable digital music players, and sells a variety of related software, services, peripherals, networking solutions, and third-party digital content and applications. Apple provides many products and services, including iPhone; iPad; iPod; Mac; Apple TV; a portfolio of consumer and professional software applications; the iOS and OS X operating systems; iCloud; and accessories, service, and support offerings. It sells its products worldwide through its retail stores, online stores, direct sales force and third-party cellular network carriers, wholesalers, retailers, and value-added resellers to the consumer and also sells third-party iPhone, iPad, Mac and iPod compatible products, including application software and accessories through its online and retail stores. Introduced in 1984, the Macintosh was the first widely sold personal computer with a graphical user interface (GUI). That feature and others such as an improved floppy drive design and a low-cost hard drive that made data retrieval faster helped Apple cultivate a reputation for innovation. Apple was named as the most admired company in the United States in 2008 and in the world from 2008 to 2012 by the Fortune magazine. The company was founded by Steven Paul Jobs, Steve Wozniak, and Ronald Gerald Wayne on April 1, 1976, and is headquartered in Cupertino, California.

Apple Careers

Join Apple, a place where extraordinary people gather to do their best work. Our ever-expanding global team is at the forefront of innovation and leadership in the tech industry. At Apple, we're not just building products—we're crafting the kind of wonder that revolutionizes entire industries. It's the diversity of our people and their ideas that inspires the innovation that runs through everything we do, from amazing technology to industry-leading environmental efforts. Work You’ll Do Embark on a journey with Apple’s market-leading team to help some of the world’s most influential companies navigate their path to digital mastery with cutting-edge technology and services. Transform industries and touch lives with your unique ideas at Apple. Here, you’ll lead through a unique position at the intersection of technology, creativity, and robust industry expertise. Collaborate with a global team of professionals who are at the top of their game in technology and design. Apple isn’t just a company, it’s a community of innovators and passionate thinkers. Introducing the Apple Innovation and Leadership Initiative We are building a market-leading team to drive our efforts in delivering groundbreaking solutions and services. At Apple, job opportunities are abundant, offering you the chance to explore diverse roles from engineering to marketing, all designed to empower your career growth. Do Innovative Work Join the largest group of creative and technical experts in the world—professionals dedicated to redefining what’s possible through technology and innovation. Deliver targeted solutions through a depth and breadth of expertise that’s unmatched, driving forward our commitment to excellence and leadership in every project we undertake. Be Part of a Great Team Engage in a wide range of projects utilizing Apple’s technology and resources. Harness the unparalleled capabilities, global scale, and joint solution development that only Apple can offer. Future-Proof Your Career Advance your career with limitless opportunities at Apple. Go as far as your ambition takes you with unmatched training, development, and certification support. Explore Discover how Apple is leading the way in tech innovation: [With iOS] Businesses can streamline operations and enhance customer interactions... READ MORE Smart home technology integration that sets the standard for convenience and security... READ MORE The Apple Experience Our combined service capabilities, global scale, and joint solution development help clients overcome challenges and lead transformation in their industries. Clients worldwide look to Apple for new strategies and solutions that drive growth and innovation in the digital era. Stay Connected Join Our Team Search open positions that match your skills and interests. We look for passionate, curious, creative, and solution-driven team players. Whether you’re seeking a professional role, an internship, or a leadership position, Apple offers a variety of employment opportunities. SEARCH APPLE JOBS Keep Up to Date Stay ahead with career tips, insider perspectives, and industry-leading insights you can put to use today—all from the people who work here. READ CAREERS BLOG Job Alert Emails Personalize your subscription to receive job alerts, latest news, and insider tips tailored to your preferences. See what exciting and rewarding opportunities await at Apple, a company committed to diversity, innovation, and leadership. Explore job opportunities, employment benefits, and the culture of growth and innovation at Apple. Prepare your resume, hone your interview skills, and ready yourself for a career at one of the most prestigious companies in the world. Join us in pushing the boundaries of what is possible.
Learn more about Apple
Size
154,000 employees
Market Cap
$2,074.3 billion
Industry
Net Income
$63.9 billion
Founded
1976
5 Year Trend
+11.5%
Revenue
$294.1 billion
NASDAQ

Similar Jobs

More Jobs at Apple

More Information Technology Jobs

Find similar ML Software Engineer jobs: