Apple

Siri, Eval Architect Engineer

Apple$140K — $180K *
Consumer Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • BS/MS/PhD in Computer Science, Software Engineering, or related field.
  • 10+ years of software engineering experience.
  • Minimum 5 years in systems architecture or technical leadership role.
  • Proven track record in designing and shipping large-scale distributed systems.
  • Deep expertise in system design including API design and data flow modeling.
  • Experience with AI-assisted software development workflows.
  • Familiarity with MLOps for model lifecycle management.

Responsibilities

  • Define the technical architecture for Siri's evaluation infrastructure.
  • Embed with teams to understand systems and make architectural decisions.
  • Lead a review of existing evaluation tools to identify gaps and opportunities.
  • Represent technical needs in leadership discussions and influence decisions.
  • Drive the technical roadmap for the evaluation platform as a whole.
  • Ensure architectural coherence across independent teams.
  • Set standards to enhance speed without creating fragmentation.

Benefits

  • Opportunities to influence high-impact AI products.
  • Collaborative environment with cross-team interaction.
  • Access to advanced technologies and tools.
  • Participation in shaping technical processes and standards.
  • Engagement with cutting-edge AI evaluation infrastructure.
Full Job Description
Do you want to define the architecture of the systems that measure Siri's quality across every platform, every locale, and every model update? Apple's Agentic Eval Engineering organization is building the evaluation infrastructure that determines how Siri's quality is measured, trusted, and improved - spanning large-scale automation on real devices, model-in-the-loop simulation, AI-powered auto-evaluators, and closed-loop agentic fix pipelines. We are seeking a senior Eval Systems Architect to own the end-to-end technical vision and system architecture across our entire evaluation stack, ensuring that we build toward a coherent, scalable, and trustworthy system. As the Eval Systems Architect, you will own the technical architecture of Siri's evaluation infrastructure - a system spanning real-device automation, simulated product evaluation, AI-powered auto-evaluators, developer workflows, and observability tooling. You will work across the Agentic Eval Engineering and Siri to ensure architectural coherence, define interfaces and contracts between systems, and drive the technical roadmap for the evaluation platform as a whole. This is not a role where you design in isolation. You will embed with teams, understand their systems deeply, and make architectural decisions that balance local team autonomy with system-wide consistency. You will lead a first-principles review of existing evaluation tooling and infrastructure - identifying gaps, redundancies, and opportunities to simplify or unify. You will represent the technical perspective in leadership discussions, influence build-vs-integrate decisions, and set the standards that enable teams to move fast without creating fragmentation. Your work will directly influence how Apple evaluates its most important AI products. Your architectural decisions will impact the speed, confidence, and quality with which Siri ships to billions of users. BS/MS/PhD in Computer Science, Software Engineering, or a related field. 10+ years of software engineering experience, with at least 5 years in a systems architecture, staff/principal engineer, or technical leadership role. Proven track record of designing and shipping large-scale distributed systems serving multiple teams or organizations. Deep expertise in system design: API design, service architecture, data flow modeling, interface contracts, and schema evolution. Solid software engineering fundamentals with production experience, including CI/CD, testing strategies, system monitoring, debugging complex multi-service systems, and code maintainability. Demonstrated expertise in using AI-assisted software development workflows to accelerate engineering while maintaining code quality. Experience architecting evaluation, testing, or quality infrastructure at scale - particularly for AI/ML products where quality is non-binary and continuous. Experience with building LLM applications, LLM-as-judge evaluation frameworks, and offline evaluation pipelines. Familiarity with MLOps principles for model lifecycle management and training data pipelines. Experience with VM orchestration, fleet management, or large-scale job scheduling systems. Knowledge of simulation and service virtualization techniques for complex software stacks. Experience with observability platforms (metrics, logging, tracing, dashboarding) and defining SLOs for platform reliability. Experience with agentic AI systems, including tool-use, multi-step reasoning, and human-in-the-loop workflows. Track record of leading cross-team architectural initiatives (e.g., platform migrations, API unification, system consolidation) in organizations with 50+ engineers

About Apple

Apple is a corporation that designs, manufactures, and markets mobile communication and media devices, personal computers, portable digital music players, and sells a variety of related software, services, peripherals, networking solutions, and third-party digital content and applications. Apple provides many products and services, including iPhone; iPad; iPod; Mac; Apple TV; a portfolio of consumer and professional software applications; the iOS and OS X operating systems; iCloud; and accessories, service, and support offerings. It sells its products worldwide through its retail stores, online stores, direct sales force and third-party cellular network carriers, wholesalers, retailers, and value-added resellers to the consumer and also sells third-party iPhone, iPad, Mac and iPod compatible products, including application software and accessories through its online and retail stores. Introduced in 1984, the Macintosh was the first widely sold personal computer with a graphical user interface (GUI). That feature and others such as an improved floppy drive design and a low-cost hard drive that made data retrieval faster helped Apple cultivate a reputation for innovation. Apple was named as the most admired company in the United States in 2008 and in the world from 2008 to 2012 by the Fortune magazine. The company was founded by Steven Paul Jobs, Steve Wozniak, and Ronald Gerald Wayne on April 1, 1976, and is headquartered in Cupertino, California.

Apple Careers

Join Apple, a place where extraordinary people gather to do their best work. Our ever-expanding global team is at the forefront of innovation and leadership in the tech industry. At Apple, we're not just building products—we're crafting the kind of wonder that revolutionizes entire industries. It's the diversity of our people and their ideas that inspires the innovation that runs through everything we do, from amazing technology to industry-leading environmental efforts. Work You’ll Do Embark on a journey with Apple’s market-leading team to help some of the world’s most influential companies navigate their path to digital mastery with cutting-edge technology and services. Transform industries and touch lives with your unique ideas at Apple. Here, you’ll lead through a unique position at the intersection of technology, creativity, and robust industry expertise. Collaborate with a global team of professionals who are at the top of their game in technology and design. Apple isn’t just a company, it’s a community of innovators and passionate thinkers. Introducing the Apple Innovation and Leadership Initiative We are building a market-leading team to drive our efforts in delivering groundbreaking solutions and services. At Apple, job opportunities are abundant, offering you the chance to explore diverse roles from engineering to marketing, all designed to empower your career growth. Do Innovative Work Join the largest group of creative and technical experts in the world—professionals dedicated to redefining what’s possible through technology and innovation. Deliver targeted solutions through a depth and breadth of expertise that’s unmatched, driving forward our commitment to excellence and leadership in every project we undertake. Be Part of a Great Team Engage in a wide range of projects utilizing Apple’s technology and resources. Harness the unparalleled capabilities, global scale, and joint solution development that only Apple can offer. Future-Proof Your Career Advance your career with limitless opportunities at Apple. Go as far as your ambition takes you with unmatched training, development, and certification support. Explore Discover how Apple is leading the way in tech innovation: [With iOS] Businesses can streamline operations and enhance customer interactions... READ MORE Smart home technology integration that sets the standard for convenience and security... READ MORE The Apple Experience Our combined service capabilities, global scale, and joint solution development help clients overcome challenges and lead transformation in their industries. Clients worldwide look to Apple for new strategies and solutions that drive growth and innovation in the digital era. Stay Connected Join Our Team Search open positions that match your skills and interests. We look for passionate, curious, creative, and solution-driven team players. Whether you’re seeking a professional role, an internship, or a leadership position, Apple offers a variety of employment opportunities. SEARCH APPLE JOBS Keep Up to Date Stay ahead with career tips, insider perspectives, and industry-leading insights you can put to use today—all from the people who work here. READ CAREERS BLOG Job Alert Emails Personalize your subscription to receive job alerts, latest news, and insider tips tailored to your preferences. See what exciting and rewarding opportunities await at Apple, a company committed to diversity, innovation, and leadership. Explore job opportunities, employment benefits, and the culture of growth and innovation at Apple. Prepare your resume, hone your interview skills, and ready yourself for a career at one of the most prestigious companies in the world. Join us in pushing the boundaries of what is possible.
Learn more about Apple
Size
154,000 employees
Market Cap
$2,074.3 billion
Industry
Net Income
$63.9 billion
Founded
1976
5 Year Trend
+11.5%
Revenue
$294.1 billion
NASDAQ

Similar Jobs

More Jobs at Apple

More Consumer Technology Jobs

Find similar Siri, Eval Architect Engineer jobs: