EPAM Systems

Senior AI Engineer with Microsoft Azure

EPAM Systems$135K — $160K *
US-Anywhere
+ 2 other locationsRemote
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 3+ years experience with production LLM/agentic systems
  • Proficiency in Python, Java Spring Boot, and/or TypeScript/Angular
  • Expertise in Azure PaaS and Azure AI services
  • Skills in agentic frameworks, vector DBs, knowledge graphs, and MCP
  • Competency in prompt and context engineering
  • Background in CI/CD and observability
  • English proficiency at B2 level or higher

Responsibilities

  • Industrialize prototypes into production services on Azure
  • Build agentic systems with choice of frameworks and integration by need
  • Construct eval harnesses with regression tests and guardrail checks
  • Engineer guardrails for data protection and human escalation
  • Deliver full stack services and manage end-to-end production engineering
  • Implement security and compliance within existing frameworks
  • Iterate and optimize solutions based on real usage evidence

Benefits

  • Opportunities for continuous learning with evolving frameworks
  • Emphasis on an evaluation-driven engineering discipline
  • Dynamic work environment adapting to new technologies
  • Access to cutting-edge Azure platforms and tools
  • Collaborative culture that encourages innovation and experimentation
Full Job Description
Senior AI Engineer with Microsoft Azure We are looking for a Senior AI Engineer with Microsoft Azure expertise to take validated prototypes and make them survive production: evals, guardrails, security, cost and scale. You will build agentic systems on the Azure stack and code AI-first every day, with the commits to prove it. We value an 80% mindset and 20% skills approach - frameworks change quarterly, and we don't hire for one. What we can't teach is evaluation-driven engineering discipline and the honesty to say what a demo hides. Responsibilities Industrialize prototypes into production services on Azure - Azure AI Foundry / Azure OpenAI - from build-ready pack to a system real users depend on in weeks Build agentic systems properly, choosing orchestration frameworks, RAG pipelines, vector DBs, knowledge graphs and MCP-based tool integration by need and engineer them for change Build the eval harness first: golden sets, regression evals and guardrail tests wired into CI, with quality measured on every change Engineer the guardrails, including input/output filtering, grounding and citation, PII protection, rate limits and human escalation paths Deliver full stack services in Python and/or Java Spring Boot along with TypeScript/Angular front ends Run production engineering end-to-end, covering CI/CD, observability with traces on every LLM call, cost and latency management and model-version churn absorbed by design Build security and compliance in, respecting data classification boundaries in prompts, stores and logs, externalizing secrets and making every AI decision auditable Iterate from real usage through hypercare, tuning and fixes based on evidence, and package patterns that worked for the next pod Requirements 3+ years of experience shipping LLM/agentic systems in production with real users, with a defined eval approach and scale Proficiency in Python, Java Spring Boot and/or TypeScript/Angular Expertise in Azure PaaS and Azure AI services Skills in agentic frameworks, vector DBs, knowledge graphs and MCP Competency in prompt and context engineering Background in CI/CD and observability, having operated what you built Familiarity with daily AI-assisted engineering, coding with AI agents and demonstrating the workflow live English proficiency at B2 level or higher

About EPAM Systems

EPAM Systems, Inc. is a leading global provider of digital platform engineering and development services. The company has a strong presence in North America, Europe, and Asia, and serves clients in a variety of industries, including financial services, healthcare, and retail. EPAM's services include software engineering, product development, and digital platform engineering, and the company has a reputation for delivering high-quality solutions that help its clients achieve their business goals. EPAM has been recognized as a leader in the digital services industry by a number of independent research firms, and the company has won numerous awards for its work.
Learn more about EPAM Systems
Size
58,824 employees
Market Cap
$18.2 billion
Industry
Net Income
$327.1 million
Founded
1993
5 Year Trend
+26.5%
Revenue
$2.6 billion
NASDAQ

Similar Jobs

More Jobs at EPAM Systems

More Information Technology Jobs

Find similar Senior AI Engineer with Microsoft Azure jobs: