Senior Backend Engineer- AI Agents (Remote)

Level AI

$120K — $160K *
US-AnywhereRemote in United States
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience in backend engineering or platform engineering
  • Proven track record in building high-scale, production-grade backend systems
  • Familiarity with real-time processing and event-driven architectures
  • Strong understanding of REST and gRPC API design
  • Experience with SQL and NoSQL databases for high-scale systems
  • Hands-on knowledge of Docker, Kubernetes, and cloud platforms like AWS, GCP, or Azure
  • Solid fundamentals in system design and performance optimization

Responsibilities

  • Design and build scalable backend systems for AI agents
  • Develop agent orchestration frameworks for complex decision-making
  • Build systems for agent memory and state persistence
  • Architect low-latency inference pipelines integrating multiple tools
  • Implement evaluation frameworks to measure AI agent performance
  • Enable continuous improvement loops for AI agents in production
  • Design event-driven workflows for complex agent tasks

Benefits

  • Competitive compensation with performance-based upside
  • Flexible vacation policy
  • Health insurance coverage
  • Work with a globally distributed, high-impact team
  • Opportunity to build cutting-edge AI products at scale
  • Regular team offsites and in-person collaboration
Full Job Description
About the role

As a Senior Engineer - AI Agents, you will play a critical role in building the scalable backend systems that power Level AI's next-generation AI Agents. These systems operate in real-time, high-volume enterprise environments and are central to delivering intelligent, production-grade AI experiences.

You will work at the intersection of distributed systems, cloud infrastructure, and AI-powered applications-bringing agentic AI capabilities into production at scale.

What you'll get to do at Level AI (and more as we grow together):

  • Design and build scalable backend systems powering AI Agents that operate in real-time enterprise environments
  • Develop agent orchestration frameworks (multi-step reasoning, tool usage, decisioning workflows)
  • Build systems for agent memory, context management, and state persistence across interactions
  • Architect low-latency inference pipelines integrating LLMs, SLMs, and external tools/services
  • Implement evaluation (evals) frameworks to measure agent performance, accuracy, and reliability
  • Enable continuous improvement loops (feedback - retraining - deployment) for AI agents in production
  • Design and manage event-driven, asynchronous workflows for complex agent tasks
  • Optimize systems for high throughput, low latency, and cost-efficient inference at scale
  • Build and maintain robust APIs and service layers (REST / gRPC) for agent capabilities
  • Partner closely with Applied AI / ML teams to productionize models and agent behaviours.
  • Collaborate with Product and Solutions teams to translate real customer workflows into agentic systems
  • Drive best practices in observability, monitoring, safety, and guardrails for AI systems
  • Contribute to architecture decisions for scaling multi-tenant, enterprise-grade AI platforms


We'll love to explore more about you if you have:

  • 5+ years of experience in backend engineering, distributed systems, or platform engineering
  • Strong experience building high-scale, production-grade backend systems
  • Experience designing systems for real-time processing, streaming, or event-driven architectures
  • Strong understanding of API design (REST, gRPC) and microservices architectures
  • Experience with databases (SQL + NoSQL) and data modeling for high-scale systems
  • Hands-on experience with Docker, Kubernetes, and cloud platforms (AWS/GCP/Azure)
  • Strong fundamentals in system design, concurrency, and performance optimization
    Strong Plus (Agent / AI focus):
  • Experience working with LLMs, conversational AI, or AI-powered products in production
  • Familiarity with agent frameworks, tool calling, or multi-step reasoning systems
  • Experience building or integrating RAG pipelines, vector databases, or retrieval systems
  • Exposure to evaluation systems (offline/online evals, A/B testing for AI systems)
  • Understanding of prompting strategies, context windows, and model behavior optimization
  • Experience with real-time decisioning systems or workflow orchestration engines


Perks & Benefits
  • Competitive compensation with performance-based upside
  • Flexible vacation policy
  • Health insurance coverage
  • Work with a globally distributed, high-impact team
  • Opportunity to build cutting-edge AI products at scale
  • Regular team offsites and in-person collaboration


To learn more visit : https://thelevel.ai/

Funding : https://www.crunchbase.com/organization/level-ai

LinkedIn : https://www.linkedin.com/company/level-ai/

Our AI platform : https://www.youtube.com/watch?v=g06q2V_kb-s

Similar Jobs

More Jobs at Level AI

More Information Technology Jobs

Find similar Senior Backend Engineer- AI Agents (Remote) jobs: