AI Architect- Associate Director

KPMG

$120K — $160K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • Minimum eight years of experience in software development and architecture, focusing on cloud-native AI applications.
  • Bachelor's degree required; master's degree in Computer Science, Engineering, or related field preferred.
  • Hands-on proficiency with LLM frameworks (LangChain/LangGraph) and core Azure services (AKS, Azure AI Search).
  • In-depth experience with Agile methodologies and tools like Azure DevOps and Git for CI/CD.
  • Excellent analytical skills for breaking down complex business problems into scalable solutions.
  • Strong communication skills for effective collaboration within cross-functional teams.

Responsibilities

  • Design and document scalable microservice architectures for key product features.
  • Collaborate with developers, QA, and product managers to define technical requirements and ensure architectural integrity.
  • Implement best practices for code quality, automated testing, and AI model evaluation using LangSmith.
  • Lead the technical design and execution of platform components, including context engineering services and HITL interfaces.
  • Mentor development pods, providing architectural oversight during design reviews and sprint resolutions.
  • Prototype new technologies and patterns before they are widely adopted across the team.

Benefits

  • Comprehensive medical and dental plans, vision coverage, disability and life insurance.
  • 401(k) plans and various personal well-being benefits to support mental health.
  • Personal Time Off, including standardized holiday breaks each year.
  • Two additional breaks each year that do not require using PTO.
Full Job Description
KPMG is currently seeking an AI Architect to join our Audit Technology Alliance organization.

Responsibilities:
  • Design and document robust, scalable microservice architectures for key product features, providing direct technical guidance to development teams
  • Collaborate daily with senior developers, QA, and product managers to define technical requirements, refine user stories, and ensure architectural integrity throughout the development lifecycle
  • Implement and enforce best practices for code quality, automated testing, and AI model evaluation using LangSmith, directly contributing to the continuous improvement of our engineering standards
  • Lead the detailed technical design and successful execution of critical platform components, including context engineering services, RAG pipelines, and intuitive human-in-the-loop (HITL) interfaces
  • Serve as a primary technical leader and mentor for development pods, providing architectural oversight through design reviews, pair programming, and resolving complex technical hurdles during sprints
  • Balance long-term architectural planning with hands-on prototyping and proof-of-concepts to validate new technologies and patterns before they are adopted across the engineering team

Qualifications:
  • Minimum eight years of recent progressive experience in software development and architecture, with significant, demonstrated experience in designing and building cloud-native AI applications
  • Bachelor's degree from an accredited college or university; master's degree from an accredited college or university in Computer Science, Engineering, or a related technical field is preferred
  • Strong, hands-on proficiency with LLM frameworks (LangChain/LangGraph), core Azure services (AKS, Azure AI Search, Service Bus), and experience integrating with data platforms like Databricks or Microsoft Fabric
  • In-depth experience working within an Agile framework, utilizing Azure DevOps and Git for source control, and a strong practical understanding of CI/CD principles
  • Excellent analytical and problem-solving skills, with a proven ability to deconstruct large-scale business problems into manageable, well-designed technical solutions
  • Clear and effective interpersonal and communication skills, essential for collaborating within a fast-paced, multi-disciplinary team of engineers, data scientists, and product managers(200TEC)

KPMG LLP and its subsidiaries ("KPMG") complies with all local/state regulations regarding displaying salary ranges. If required, the ranges displayed below or via the URL below are specifically for those potential hires who will work in the location(s) listed. Any offered salary is determined based on relevant factors such as applicant's skills, job responsibilities, prior relevant experience, certain degrees and certifications and market considerations. In addition, KPMG is proud to offer a comprehensive, competitive benefits package, with options designed to help you make the best decisions for yourself, your family, and your lifestyle. Available benefits are based on eligibility. Our Total Rewards package includes a variety of medical and dental plans, vision coverage, disability and life insurance, 401(k) plans, and a robust suite of personal well-being benefits to support your mental health. Depending on job classification, standard work hours, and years of service, KPMG provides Personal Time Off per fiscal year. Additionally, each year KPMG publishes a calendar of holidays to be observed during the year and provides eligible employees two breaks each year where employees will not be required to use Personal Time Off; one is at year end and the other is around the July 4th holiday. Additional details about our benefits can be found towards the bottom of our KPMG US Careers site at Benefits & How We Work .

Follow this link to obtain salary ranges by city outside of CA:
https://kpmg.com/us/en/how-we-work/pay-transparency.html/?id=8152_9_26

Similar Jobs

More Jobs at KPMG

More Information Technology Jobs

Find similar AI Architect- Associate Director jobs: