SAP

SAP AI Architect - Multiple Locations

SAP$167K — $371K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Strong business process acumen for AI solution translation
  • Proficiency in SAP BTP services and tools
  • Advanced expertise in Generative AI architectures
  • Knowledge of machine learning frameworks (TensorFlow, PyTorch)
  • Familiarity with front-end development and API consumption
  • Hands-on experience with MLOps/LLMOps pipelines
  • Understanding of SAP's AI partnerships and offerings

Responsibilities

  • Define AI strategy and architecture with customer stakeholders
  • Lead sessions to identify AI use cases and roadmap
  • Architect AI solutions using SAP technologies
  • Design and manage APIs and microservices for integration
  • Utilize BTP capabilities for data orchestration and analytics
  • Develop reference architectures for advanced AI patterns
  • Establish best practices for AI workloads governance,

Benefits

  • Comprehensive health and wellness programs
  • Flexible work arrangements including hybrid options
  • Professional development and training opportunities
  • Paid time off and holidays
  • Retirement savings plans with company match
Full Job Description
What you'll build

We are seeking a seasoned SAP AI Architect to lead the design, development, and deployment of AI driven solutions within our SAP ecosystem.
The ideal candidate brings deep expertise in SAP technologies, modern AI frameworks, and the SAP Business Technology Platform (BTP), enabling seamless integration of AI capabilities that drive innovation, automation, and measurable business value.

Key Responsibilities
• Partner with customer stakeholders to define AI strategy, target architecture, and enterprise grade AI solutions that enhance business processes and deliver tangible outcomes.
• Lead SAP AI discovery sessions and workshops to identify high value use cases, shape AI adoption roadmaps, and accelerate data driven decision making for SAP customers.
• Architect robust AI solutions leveraging SAP technologies such as Generative AI Hub, BTP, AI Core, Joule, Business Application Studio, Build Code, HANA, S/4HANA, Business Data Cloud, and Integration Suite.
• Design and manage APIs, microservices, and integrations using SAP BTP services to ensure seamless interoperability across SAP and non SAP systems.
• Utilize SAP BTP capabilities for data orchestration, analytics, vector search, and machine learning model deployment.
• Develop reference architectures for advanced AI patterns such as RAG, multi agent orchestration, A2A automation, MCP, and hybrid AI scenarios.
• Design and guide implementation of enterprise grade LLMOps/MLOps pipelines to support continuous delivery, monitoring, and lifecycle management of AI models.
• Establish and enforce architectural best practices covering governance, scalability, security, observability, and operational excellence for AI workloads.
• Ensure Responsible AI adoption, regulatory compliance, performance optimization, and cost efficient solution design.
• Contribute to reusable accelerators, frameworks, templates, and solution assets that scale AI adoption across customer engagements.
• Collaborate with SAP product engineering, services teams, and partners to deliver end to end AI transformation programs.
• Provide technical leadership, coaching, and mentorship to engineering, data science, and consulting teams.
• Stay current on emerging AI technologies, SAP Data + AI innovations, and industry trends to drive continuous improvement and customer innovation.

What you bring
• Strong business process acumen with the ability to translate complex challenges into actionable, AI enabled solutions.
• An AI-first mindset professional with excellent problem-solving, communication, and leadership skills
• Proficiency across SAP BTP services, including SAP AI Core, AI Business Services, Integration Suite, and Extension Suite.
• Advanced expertise in Generative AI architectures such as RAG, agent orchestration, and model fine tuning/customization.
• Strong knowledge of machine learning frameworks (e.g., TensorFlow, PyTorch) and programming languages (e.g., Python, Java).
• Deep understanding of Generative AI, prompt engineering, and LLM driven solution design.
• Front end development familiarity (JavaScript, HTML, Fiori Web Components) and experience consuming APIs.
• Experience with agentic systems, multi agent coordination, tool calling frameworks, and A2A/MCP patterns.
• Hands on experience implementing MLOps/LLMOps pipelines and model lifecycle governance.
• Practical experience with frameworks such as LangChain, LangGraph, CrewAI, or similar orchestration tools.
• Knowledge of vector databases, semantic retrieval techniques, and knowledge graph architectures.
• Experience with S/4HANA, SAP Business Data Cloud, SAP Analytics Cloud, HANA Cloud, and knowledge of SAP AI offerings
• Understanding of SAP's AI partnerships (e.g., Microsoft, Google, AWS, NVIDIA, Anthropic, Palantir) and how these capabilities complement SAP BTP, Data & AI solutions a plus

Compensation Range Transparency: SAP believes the value of pay transparency contributes towards an honest and supportive culture and is a significant step toward demonstrating SAP's commitment to pay equity. SAP provides the annualized compensation range inclusive of base salary and variable incentive target for the career level applicable to the posted role. The targeted annual combined range for this position is [redacted]00USD. The actual amount to be offered to the successful candidate will be within that range, dependent upon the key aspects of each case which may include education, skills, experience, scope of the role, location, etc. as determined through the selection process. Any SAP variable incentive includes a targeted dollar amount and any actual payout amount is dependent on company and personal performance. Please reference this link for a summary of SAP benefits and eligibility requirements: SAP North America Benefits.

Requisition ID: 455556 | Work Area: Consulting and Professional Services | Expected Travel: 0 - 30% | Career Status: Professional | Employment Type: Regular Full Time | Additional Locations: #LI-Hybrid

Requisition ID: 455556

Posted Date: Jun 12, 2026

Work Area: Consulting and Professional Services

Career Status: Professional

Employment Type: Regular Full Time

Expected Travel: 0 - 30%

Location:

Similar Jobs

More Jobs at SAP

More Information Technology Jobs

Find similar SAP AI Architect - Multiple Locations jobs: