AI Engineer

Air

$90K — $130K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of experience in AI Engineering or related fields
  • Proficient in integrating and working with Large Language Models (LLMs)
  • Experience with agent frameworks like Claude and OpenAI SDKs
  • Strong background in building and evaluating ML systems with telemetry and reliability metrics
  • Proven capability to thrive in ambiguous and fast-paced environments

Responsibilities

  • Design and develop multi-agent systems that utilize tools, memory, and planning
  • Create modular and composable Agent Skills and tools for backend integration
  • Oversee technical architecture and engineering standards for scalability and maintenance
  • Implement automated evaluation processes for agents throughout their lifecycle
  • Collaborate with Product and Implementation teams to address complex challenges using agent technology

Benefits

  • Full-time position with a collaborative team environment
  • Opportunity to work on cutting-edge AI applications in a growing sector
  • Potential for career advancement in a startup culture
  • Travel opportunities for professional engagement
  • Emphasis on continuous learning and technological exploration
Full Job Description
Job Description

We are seeking an experienced AI Engineer to join our Agentic AI team as we scale our agentic offerings across all levels of the US government. Over the past year, we have seen the rapid adoption of our agent, Ace. We expect Ace to be handling much more complex tasks and workflows end-to-end or in cooperation with a human user as time goes on. The team is striving to make Ace an even more effective agent, focusing on planning, reliable execution over longer time horizon tasks, scaled tool use, Ace Skills, memory, and inter-agent coordination.

In order to do this job well, we are looking for someone who can demonstrate a project built on LLMs that showcases your skill at getting them to do complex tasks.
  • Experience integrating and working with LLMs, with a strong understanding of their capabilities and limitations
  • Experience integrating and working with agent frameworks like Claude Agent SDK or OpenAI Agent SDK
  • Experience building observability, evaluation, and feedback loops for agent behavior (telemetry, prompt evaluation, regression testing, and reliability metrics).
  • Experience working in highly ambiguous environments, and operate with urgency
  • Startup experience, particularly in scaling products from zero to one

Strong Candidates have:
  • Experience designing and deploying complex agentic systems using LLMs
  • Hands-on work with multi-agent coordination, routing, and tool orchestration
  • Love coding agents

This role is a full-time position located out of our office in Pittsburgh, PA.

This role may require up to 25% travel

Scope of Responsibilities
  • Designs and builds multi-agent systems with tool use, memory, routing, and planning
  • Develops Agent Skills and tools as modular, composable services that interact with backend systems, models, and data processing
  • Own the technical architecture and engineering standards for agentic systems, ensuring scalability, reliability, and maintainability
  • Assist with automated evaluation of agents, skills, and prompts across the entire product lifecycle
  • Work with our Product and Implementation organizations to find solutions to our most vexing challenges, applying agents to our customer problems


Qualifications
  • U.S. Citizenship is required

Required Skills:

  • Bachelor's, Master's, or Doctorate in Computer Science, Computer Engineering, Data Science, or a related field
  • Minimum 1 year of experience building and deploying ML or LLM-powered systems in production environments
  • Practical experience in building, developing, and productionizing machine learning systems
  • Advanced software skills in Python
  • Experience with common LLM algorithms and implementations
  • Hands-on experience with AWS and cloud infrastructure
  • A strong desire to learn and investigate new technologies
  • Familiarity with Git source control management
  • Ability to work collaboratively with little supervision
  • A burning desire to work in a challenging, fast-paced tech environment


Desired Skills:
  • Current possession of a U.S. security clearance, or the ability to obtain one with our sponsorship
  • Experience in or exposure to the nuances of a startup or other entrepreneurial environment
  • Comfortable with Claude Code and GenAI coding best practices.


We firmly believe that past performance is the best indicator of future performance. If you thrive while building solutions to complex problems, are a self-starter, and are passionate about making an impact in global security, we're eager to hear from you.

Similar Jobs

More Jobs at Air

More Information Technology Jobs

Find similar AI Engineer jobs: