BMC Software

Principal AI Engineer

BMC Software$175K — $293K *
Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 8+ years in building and operating scalable, production-grade software, particularly in AI/ML
  • Experience in designing and shipping agentic AI systems and workflows
  • Hands-on proficiency in evaluation and experimentation frameworks for LLM/agentic systems
  • Strong knowledge of modern agent/LLM frameworks (LangGraph, Google ADK, etc.)
  • Familiarity with RAG, retrieval techniques, and production monitoring principles
  • Solid foundation in software engineering with tools like Git, Docker, and Kubernetes
  • Ability to thrive in fast-paced and ambiguous environments while demonstrating strong leadership skills

Responsibilities

  • Architect and own the end-to-end development of agentic systems
  • Prototype new agent capabilities and drive production-ready implementations
  • Build and integrate across the entire AI stack, from RAG to inference serving
  • Establish evaluation strategies to ensure safe production deployments of agents
  • Define performance metrics and build observability into multi-turn interactions
  • Mentor engineers and set clear technical direction across teams
  • Translate complex technical concepts into understandable guidance for partners and customers

Benefits

  • Inclusive culture that celebrates individual authenticity
  • Encouragement of diverse backgrounds and experiences in candidates
  • Opportunities for mentorship and professional growth
  • Collaborative environment with a global team of over 6000 employees
Full Job Description
Description and Requirements

CareerArc Code

CA-BS

#LI-BS1

Hybrid: #LI-Hybrid

We9re looking for a Principal AI Engineer to architect, build, and harden the agentic AI systems that power our products. This is a hands-on, full-stack AI role: you9ll work across the entire AI stack from the foundation (model lifecycle, experimentation, infrastructure) through shared services (agent orchestration, RAG and grounding, gateways and routing) up to the agents and workflows that reach customers. You9ll set the technical direction for how we design agents, prove what works through rigorous evaluation, and turn promising prototypes into reliable, observable, governed production systems.

Here is how, through this role, you will contribute to BMC9s and your own success:

  • Own the architecture for agentic systems end to end - reasoning and planning, tool/function calling, multi-agent coordination, routing, memory, and human-in-the-loop handoffs and define reusable patterns and reference implementations.
  • Prototype new agentic capabilities quickly, then drive the ones that prove into production-grade systems; write production-quality code and set the engineering bar.
  • Build and integrate across the stack: RAG and knowledge services, model/tool routing, prompt and context management, orchestration runtimes, and inference serving. Evaluate and adopt emerging models, frameworks, and protocols.
  • Stand up the evaluation and experimentation strategy that gates what we ship, offline suites and golden datasets, regression tests in CI/CD, online evaluators on production traffic, calibrated LLM-as-a-judge graders, and A/B experiments to ensure safe and reliable deployments of agents in production.
  • Define the metrics that matter (task success, grounded-ness, cost, safety, etc.) and define and build the tracing and observability to measure them across multi-turn interactions, closing the loop from error analysis to continuous improvement.
  • Set technical direction across teams, mentor engineers, and translate complex architectures into clear guidance for partners and customers.


To ensure you9re set up for success, you will bring the following skillset & experience:

  • 8+ years of building and operating scalable, production-grade software, with significant recent depth in AI/ML.
  • Proven experience designing, building, and shipping agentic AI systems (autonomous/multi-step agentic workflows, multi-agent frameworks, and Generative AI copilots) in production.
  • Hands-on experience building evaluation and experimentation frameworks for LLM/agentic systems (offline + online evals, LLM-as-a-judge, benchmarking, CI/CD gates, production monitoring).
  • Strong agentic engineering skills, with modern agent/LLM frameworks (e.g., LangGraph, Google ADK, or comparable).
  • Experience with RAG and retrieval (vector stores, grounding, citations) and familiarity with AgentOps/LLMOps and production monitoring.
  • Solid software engineering fundamentals with productization tooling: Git, Docker, Kubernetes, CI/CD, and cloud (AWS / Azure / GCP).
  • The judgment to operate in fast-moving, ambiguous environments and the communication skills to lead without authority.
  • Experience with model customization (SFT, RLHF, DPO/GRPO), eval/observability platforms and bridging applied research and engineering is a nice to have.


Our commitment to you!

BMC9s culture is built around its people. We have 6000+ brilliant minds working together across the globe. You won9t be known just by your employee number, but for your true authentic self. BMC lets you be YOU!

If after reading the above, You9re unsure if you meet the qualifications of this role but are deeply excited about BMC and this team, we still encourage you to apply! We want to attract talents from diverse backgrounds and experience to ensure we face the world together with the best ideas!

The annual base salary range represents the low and high end of the BMC salary range for this position. Actual salaries depend on a wide range of factors that are considered in making compensation decisions, including but not limited to skill sets; experience and training, licensure, and certifications; and other business and organizational needs.

The range listed is just one component of BMC9s employee compensation package. Other rewards may include a variable plan and country specific benefits.

At BMC, it is not typical for an individual to be hired at /near the top of the range. A reasonable estimate of the current range is $175,800 - $293,000

Min salary

175,800

Mid point salary

234,400

Max salary

293,000

Min Salary - NEW

175,800

Max Salary - NEW

293,000

About BMC Software

BMC Software is a software company that provides IT management solutions for businesses. The company was founded in 1980 and is headquartered in Houston, Texas. BMC Software's products include solutions for cloud management, mainframe automation, and IT service management. The company has over 10,000 customers in over 120 countries.
Learn more about BMC Software
Size
7,000 employees
Industry
Founded
1980

Similar Jobs

More Jobs at BMC Software

More Enterprise Technology Jobs

Find similar Principal AI Engineer jobs: