Veeam Software

Staff AI Engineer

Veeam Software$265K — $493K *
US-AnywhereRemote in United States
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years in AI/ML integration with production backend systems
  • Experience delivering LLM-powered capabilities end-to-end
  • Proficient in designing agentic workflows and tool reliability
  • Knowledge of Model Context Protocol (MCP) for server architecture
  • Skilled in prompt engineering and evaluation techniques
  • Experience with multi-tenant systems and data security
  • Familiarity with cloud authentication, particularly OAuth 2.0 and OIDC

Responsibilities

  • Lead the development of agentic AI systems and orchestration patterns
  • Own prompt engineering workflows and evaluation criteria
  • Design and manage MCP server infrastructure for AI agents
  • Define AI quality benchmarks and drive continuous improvements
  • Ensure security in AI systems against threats and vulnerabilities
  • Optimize AI performance across large datasets and cloud regions
  • Mentor team members and contribute to architectural decisions

Benefits

  • Unlimited paid time off and 12 paid holidays
  • Paid parental leave of 8 weeks for all parents
  • Comprehensive medical, dental, and vision coverage from day one
  • Mental health support and therapy resources available
  • 401(k) plan with company matching contributions
  • Support for fertility, adoption, and surrogacy
  • 24/7 virtual veterinary care at no cost via AirVet
  • Legal services and identity protection options
  • Tax-advantaged accounts for healthcare and commuting
  • Learning and growth opportunities through mentoring and workshops
Full Job Description
About the Role

The VDC Intelligence team is Veeam's AI and data intelligence engine, operating across the full platform to deliver threat detection, agentic infrastructure, and AI Trust capabilities at enterprise scale. As a Staff AI Engineer, you will design, build, and own production AI systems that help Veeam's customers extract meaningful insights from their enterprise data, leading technical decisions on agentic workflows, threat detection, LLM-powered assistants, and the MCP infrastructure that ties it all together. This is a software engineering role at its core: you will own capabilities end to end, from API and service design through AI integration, cloud infrastructure, and production operations. You will also mentor peers, drive architectural decisions, and partner closely with product and platform teams to deliver customer-facing impact.
What You'll Do
  • Lead agentic AI development, including multi-agent orchestration patterns, agent-to-agent protocols, and reliable tool use at production scale
  • Own prompt engineering and evaluation workflows including structured outputs, hallucination reduction, and behavioral consistency
  • Build and own MCP server infrastructure that exposes backup data to AI agents via the Model Context Protocol, enforcing tenant-aware RBAC, query constraints, and safe tool boundaries
  • Define AI quality benchmarks for retrieval relevance, summarization accuracy, and agent reliability, and drive systematic improvements through eval-driven iteration
  • Champion security and safety in AI systems, including adversarial prompt hardening, jailbreak resistance, data boundary enforcement, and OWASP LLM Top 10 awareness
  • Tune AI workflows for performance, cost, latency, and observability across billions of documents in global regions
  • Mentor engineers on the team, raise the technical bar, and contribute to architecture reviews and design decisions
Technologies You'll Work With

Azure OpenAI Service, Kubernetes, Cosmos DB, Blob Storage, Event Bus, Model Context Protocol (MCP), OAuth 2.0, OIDC, Azure AD / Entra ID
What You'll Bring
  • Proven experience integrating AI/ML services and APIs into production backend systems, including APIs, async pipelines, and cloud infrastructure, treating models and inference endpoints as components in a larger service architecture
  • Hands-on experience shipping LLM-powered capabilities end to end, such as embeddings pipelines, RAG, summarization, or LLM-powered assistants, with a strong understanding of failure modes
  • Experience designing and operating multi-step agentic workflows with real tool use, including strategies for reliability, observability, and recovery
  • Working knowledge of Model Context Protocol (MCP), including building MCP servers, designing tool exposure contracts, or integrating MCP into agent workflows
  • Experience with prompt engineering and evaluation including structured outputs, hallucination reduction, evals frameworks, and LLM observability tooling
  • Experience building multi-tenant systems with data boundary enforcement, tenant-aware access controls, and LLM safety guardrails
  • Familiarity with authentication and authorization patterns including OAuth 2.0, OIDC, JWT, and API key management in cloud backend systems
Bonus Skills
  • Experience integrating with enterprise identity providers such as Azure AD / Entra ID or Okta
  • Familiarity with AI governance concepts including data access policies, audit trails, or agent guardrail frameworks
  • Background working with heterogeneous, multilingual, or large-scale enterprise data environments
  • Experience with adversarial prompt hardening and OWASP LLM Top 10 security patterns


What you'll get
  • Unlimited paid time off, 12 paid holidays including 4 global VeeaMe Days for self-care and 24 paid volunteer hours annually through Veeam Cares
  • Paid parental leave: 8 weeks for all parents, 16 weeks for birthing parents
  • Medical, dental, and vision coverage starting on your first day
  • Mental health support, therapy sessions, and digital wellness tools via our Employee Assistance Program
  • 401(k) retirement plan with company matching contributions
  • Fertility, adoption, and surrogacy support through Maven, plus paid volunteer time
  • AirVet: 24/7 virtual veterinary care at no cost
  • Legal services, identity protection, and supplemental health insurance options
  • Tax-advantaged spending accounts for healthcare, dependent care, and commuting
  • Opportunities to learn and grow through on-demand libraries (LinkedIn Learning, O'Reilly), mentoring, workshops, and learning events like our annual Global Day of Learning

Compensation Transparency

Veeam is committed to pay transparency and equitable compensation. For this role, the compensation range below reflects the expected total target compensation (TTC), inclusive of base pay and a competitive performance-based bonus. For roles with a commission plan, the compensation range represents On Target Earnings (OTE), which includes base salary plus variable commission. When determining compensation, Veeam takes into consideration factors such as experience, education, skills, and geographic zone. Offers are typically made below the midpoint of the range.

In addition to compensation, Veeam provides a comprehensive benefits package, including health coverage, retirement plans, and unlimited time off.

U.S. Geographic Zones & Compensation Ranges (TTC / OTE)

Zone 1: San Francisco Bay Area, New York City Boroughs

$366,300-$680,200 USD

Zone 2: Washington, California (excluding San Francisco Bay Area)

$335,800-$623,500 USD

Zone 3: Texas, Illinois, North Carolina, Colorado, Massachusetts, Pennsylvania, Virginia, Oregon, Nevada, Hawaii, New York (excluding NYC boroughs); Sales roles located in Georgia, Ohio, and Arizona

$305,200-$566,800 USD

Zone 4: All other US locations

$265,600-$493,100 USD

About Veeam Software

Veeam Software is a privately held information technology company that develops backup, disaster recovery and intelligent data management software for virtual, physical and multi-cloud infrastructures. The company's headquarters are in Baar, Switzerland, and it has offices in more than 30 countries. Veeam has more than 375,000 customers worldwide, including 82% of the Fortune 500 and 69% of the Global 2,000 enterprises. The company was founded in 2006 by Ratmir Timashev and Andrei Baronov.
Learn more about Veeam Software
Size
5,000 employees
Industry
Founded
2006

Similar Jobs

More Jobs at Veeam Software

More Information Technology Jobs

Find similar Staff AI Engineer jobs: