We are seeking a highly skilled and driven Principal Machine Learning Engineer to design and deliver intelligent, distributed systems that power large-scale AI and large language model (LLM) capabilities. In this role, you will shape cutting-edge infrastructure, mentor world-class engineers, and bring bold ideas from concept to production-driving meaningful impact across SAP's global ecosystem

Description
As a key member of our fast-moving team, you will have the unique opportunity to define and execute the vision for AI and LLM-based systems at scale. We are looking for someone with exceptional programming expertise, deep distributed systems knowledge, and the curiosity and grit to tackle complex, ambiguous challenges. You will work across a diverse technology stack, collaborate closely with engineers and product leaders, and help set the technical direction for AI initiatives

Key Responsibilities

• Architect, design, and implement production systems in Go, Java and Python (full-stack experience a plus)
• Build and optimize backend services, databases, APIs, and LLM infrastructure
• Leverage technologies such as Kafka, Postgres, Hana, gRPC, and advanced LLM frameworks
• Mentor and guide engineers from junior to senior levels, fostering technical excellence
• Partner with cross-functional teams to translate business goals into scalable, high-impact solutions

Minimum Qualifications

• Bachelor's degree in Computer Science, Mathematics, Physics, or related field, with strong programming expertise
• 10+ years of software engineering experience, with a track record of delivering complex systems
• Proven ability to work independently and lead initiatives from idea to deployment
• Hands-on experience with AI/ML and/or LLM systems in a production environment
• Expertise in distributed systems design and implementation
• Familiarity with CI/CD pipelines and modern development practices
• Strong English communication skills and ability to thrive in global, multicultural team

Preferred Qualifications

• Open-source contributions or significant personal technical projects
• Experience integrating AI capabilities into large-scale enterprise products
• Strong problem-solving skills and an iterative, results-oriented mindset

Why Join Us

• Build cutting-edge AI and LLM systems used across SAP's global platform
• Work in a high-autonomy, trust-based environment without unnecessary bureaucracy
• Collaborate with some of the best engineers in the industry in a fast-paced, impact-driven team
• Take ownership of projects that directly influence SAP's AI strategy and product capabilities

#SAPAICareers #SAPAIAPP

Bring out your best
SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose-driven and future-focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best.

Requisition ID: 446278 | Work Area: Software-Design and Development | Expected Travel: 0 - 10% | Career Status: Professional | Employment Type: Regular Full Time | Additional Locations: #LI-Hybrid

Requisition ID: 446278

Posted Date: Jun 22, 2026

Work Area: Software-Design and Development

Career Status: Professional

Employment Type: Regular Full Time

Expected Travel: 0 - 10%

Location: