EPAM Systems

Senior AI Engineer with Microsoft Azure

EPAM Systems$120K — $160K *
US-AnywhereRemote in Georgia, US
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 3+ years of experience in shipping large language model (LLM) and agentic systems into production
  • Proficiency in Python, Java Spring Boot, and/or TypeScript/Angular
  • Expertise in Azure Platform as a Service (PaaS) and AI services
  • Knowledge of agentic frameworks, vector databases, and knowledge graphs
  • Experience with CI/CD processes and observability for production systems
  • Ability to engineer prompts and context effectively
  • English proficiency at B2 level or higher

Responsibilities

  • Industrialize prototypes into production-ready services on Azure AI Foundry and Azure OpenAI
  • Build agentic systems with appropriate orchestration frameworks and integration tools
  • Create evaluation harnesses including golden sets and guardrail tests within CI
  • Engineer guardrails for input/output filtering, PII protection, and user escalation paths
  • Deliver full-stack services with a focus on Python, Java Spring Boot, and TypeScript/Angular
  • Manage production engineering processes including CI/CD and observability
  • Ensure security and compliance in AI decision-making and data handling

Benefits

  • Collaborative work environment fostering innovation and continuous learning
  • Exposure to cutting-edge technologies in AI and cloud solutions
  • Opportunity to work on high-impact projects with real user applications
  • Flexibility in adapting to new frameworks and methodologies
  • Support for professional growth in AI engineering disciplines
Full Job Description
Senior AI Engineer with Microsoft Azure We are looking for a Senior AI Engineer with Microsoft Azure expertise to take validated prototypes and make them survive production: evals, guardrails, security, cost and scale. You will build agentic systems on the Azure stack and code AI-first every day, with the commits to prove it. We value an 80% mindset and 20% skills approach - frameworks change quarterly, and we don't hire for one. What we can't teach is evaluation-driven engineering discipline and the honesty to say what a demo hides. Responsibilities Industrialize prototypes into production services on Azure - Azure AI Foundry / Azure OpenAI - from build-ready pack to a system real users depend on in weeks Build agentic systems properly, choosing orchestration frameworks, RAG pipelines, vector DBs, knowledge graphs and MCP-based tool integration by need and engineer them for change Build the eval harness first: golden sets, regression evals and guardrail tests wired into CI, with quality measured on every change Engineer the guardrails, including input/output filtering, grounding and citation, PII protection, rate limits and human escalation paths Deliver full stack services in Python and/or Java Spring Boot along with TypeScript/Angular front ends Run production engineering end-to-end, covering CI/CD, observability with traces on every LLM call, cost and latency management and model-version churn absorbed by design Build security and compliance in, respecting data classification boundaries in prompts, stores and logs, externalizing secrets and making every AI decision auditable Iterate from real usage through hypercare, tuning and fixes based on evidence, and package patterns that worked for the next pod Requirements 3+ years of experience shipping LLM/agentic systems in production with real users, with a defined eval approach and scale Proficiency in Python, Java Spring Boot and/or TypeScript/Angular Expertise in Azure PaaS and Azure AI services Skills in agentic frameworks, vector DBs, knowledge graphs and MCP Competency in prompt and context engineering Background in CI/CD and observability, having operated what you built Familiarity with daily AI-assisted engineering, coding with AI agents and demonstrating the workflow live English proficiency at B2 level or higher

About EPAM Systems

EPAM Systems, Inc. is a leading global provider of digital platform engineering and development services. The company has a strong presence in North America, Europe, and Asia, and serves clients in a variety of industries, including financial services, healthcare, and retail. EPAM's services include software engineering, product development, and digital platform engineering, and the company has a reputation for delivering high-quality solutions that help its clients achieve their business goals. EPAM has been recognized as a leader in the digital services industry by a number of independent research firms, and the company has won numerous awards for its work.
Learn more about EPAM Systems
Size
58,824 employees
Market Cap
$18.2 billion
Industry
Net Income
$327.1 million
Founded
1993
5 Year Trend
+26.5%
Revenue
$2.6 billion
NASDAQ

Similar Jobs

More Jobs at EPAM Systems

More Information Technology Jobs

Find similar Senior AI Engineer with Microsoft Azure jobs: