Lead AI Engineer

Air

$120K — $160K *
Enterprise Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's, Master's, or Doctorate in Computer Science, Computer Engineering, Data Science, or a related field
  • 3+ years of experience in ML or LLM-powered systems in production environments
  • 2+ years of experience leading or mentoring engineering teams
  • Advanced software skills in Python
  • Hands-on experience with common LLM algorithms and AWS cloud infrastructure
  • U.S. Citizenship required
  • Strong desire to learn and investigate new technologies

Responsibilities

  • Design and build multi-agent systems with advanced capabilities
  • Develop modular, composable Agent Skills and tools for backend interaction
  • Automate evaluation of agents and skills throughout the product lifecycle
  • Collaborate with Product and Implementation teams to solve complex customer challenges
  • Lead Agile ceremonies and technical planning for the team

Benefits

  • Full-time position based in Pittsburgh, PA
  • May require up to 10% travel
  • Opportunity to work on cutting-edge AI technology
  • Collaborative and fast-paced work environment
  • Impactful role in the field of global security
Full Job Description
Job Description

We are seeking an experienced Lead AI Engineer to lead our Agentic AI team as we scale our agentic offerings across all levels of the US government. Over the past year, we have seen the rapid adoption of our agent, Ace. We expect Ace to be handling much more complex tasks and workflows end-to-end and/or in cooperation with a human user as time goes on. The team is striving to make Ace an even more effective agent, focusing on planning, reliable execution over longer time horizon tasks, scaled tool use, Ace Skills, memory, and inter-agent coordination.

In order to do this job well, we are looking for someone who can demonstrate a project built on LLMs that showcases your skill at getting them to do complex tasks.
  • Experience leading agentic system development from ideation through production, including technical design, architecture decisions, and day-to-day leadership of Data Scientists and Machine Learning Engineers
  • Experience integrating and working with LLMs, with a strong understanding of their capabilities and limitations
  • Experience integrating and working with agent frameworks like Claude Agent SDK or OpenAI Agent SDK
  • Experience building observability, evaluation, and feedback loops for agent behavior (telemetry, prompt evaluation, regression testing, and reliability metrics).
  • Experience working in highly ambiguous environments, and operating with urgency
  • Lead Agile ceremonies and technical planning for the Agentic AI team

Strong Candidates have:
  • Experience designing and deploying complex agentic systems using LLMs
  • Hands-on work with multi-agent coordination, routing, and tool orchestration
  • Passion for building autonomous and semi-autonomous systems that solve real customer problems

This role is a full-time position located out of our office in Pittsburgh, PA.

This role may require up to 10% travel

Scope of Responsibilities
  • Designs and builds multi-agent systems with tool use, memory, routing, and planning
  • Develops Agent Skills and tools as modular, composable services that interact with backend systems, models, and data processing
  • Assist with automated evaluation of agents, skills, and prompts across the entire product lifecycle
  • Work with our Product and Implementation organizations to find solutions to our most vexing challenges applying agents to our customer problems


Qualifications
  • U.S. Citizenship is required


Required Skills:
  • Bachelor's, Master's, or Doctorate in Computer Science, Computer Engineering, Data Science, or a related field
  • Minimum 3 years of experience building and deploying ML or LLM-powered systems in production environments
  • Minimum 2 years of experience leading or mentoring engineering teams in production environments
  • Practical experience in building, developing, and productionizing machine learning systems
  • Advanced software skills in Python
  • Experience with common LLM algorithms and implementations
  • Hands-on experience with AWS and cloud infrastructure
  • A strong desire to learn and investigate new technologies
  • Familiarity with Git source control management
  • Ability to work collaboratively with little supervision
  • A burning desire to work in a challenging, fast-paced tech environment

Desired Skills:
  • Current possession of a U.S. security clearance, or the ability to obtain one with our sponsorship
  • Experience in or exposure to the nuances of a startup or other entrepreneurial environment
  • Experience with Claude Code and GenAI coding best practices.


We firmly believe that past performance is the best indicator of future performance. If you thrive while building solutions to complex problems, are a self-starter, and are passionate about making an impact in global security, we're eager to hear from you.

Similar Jobs

More Jobs at Air

More Enterprise Technology Jobs

Find similar Lead AI Engineer jobs: