Senior Backend Engineer, LangSmith Deployments

LangChain, Inc

$175K — $240K *
Enterprise Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 4+ years of professional backend engineering experience
  • Strong proficiency in Go and/or Python
  • Experience with distributed systems including consensus mechanisms and workflow orchestration
  • Experience with scaling and sharding databases in high throughput environments
  • Familiarity with Kubernetes, infrastructure-as-code, and at least one major cloud platform
  • Strong communication skills to collaborate effectively in a small team

Responsibilities

  • Design distributed queue and worker systems for agent execution and coordination
  • Own core data infrastructure including state persistence and job claiming
  • Collaborate on scalable and robust architectural decisions
  • Ship resumable streaming infrastructure for uninterrupted client connections
  • Instrument and monitor production systems for health and performance
  • Participate in on-call rotations and manage incident response
  • Create and maintain technical documentation and operational runbooks
  • Contribute to open-source LangGraph for community use

Benefits

  • Health and dental coverage
  • Flexible vacation policy
  • 401(k) plan
  • Life insurance coverage
  • Competitive compensation package including equity
Full Job Description
About the Team

The Deployment team builds the platform that runs AI agents in production. We design and scale the core durable execution runtime to power reliable long-running agents with resumable streaming and inter-agent protocol support. We work closely with open source and other product teams to make it easy to bring any agent from prototype to production.

About the role

We're building purpose-built infrastructure for running AI agents. Unlike traditional web apps, agents run for long durations, collaborate asynchronously with humans and other agents, and need to survive failures mid-execution. LangSmith Deployments is the runtime that makes this work, with durable checkpointing, fault-tolerant orchestration, and horizontal scaling, deployed across cloud and self-hosted environments.

What You'll Do

We're looking for a Senior Backend Engineer to work on this system. While the focus is on backend development, strong familiarity with Kubernetes (K8s), Terraform (Tf), and other DevOps tooling is highly preferred.
  • Design distributed queue and worker systems that handle concurrent agent execution, background tasks, and multi-agent coordination across horizontally scalable infrastructure
  • Own core data infrastructure - state persistence, atomic job claiming, connection management, and schema evolution
  • Collaborate on architectural decisions, ensuring solutions are scalable and robust.
  • Ship resumable streaming infrastructure so clients can disconnect and reconnect mid-execution without losing state
  • Instrument and monitor production systems - tracing, metrics, and alerting to keep the platform healthy
  • Participate in on-call rotations and own incident response for the runtime
  • Create and maintain technical documentation, including system design and operational runbooks.
  • Contribute to and extend open-source LangGraph, which is used by thousands of developers to build agent applications
What You'll Bring
  • 4+ years of professional backend engineering experience
  • Strong proficiency in Go and/or python
  • Experience with distributed systems - conensus mechanisms, queueing, state machines, and/or workflow orchestration
  • Experience with scaling and sharding databases in high throughput environments
  • Familiarity with Kubernetes, infrastructure-as-code, and at least one major cloud platform
  • Strong communication skills and ability to work cross-functionally on a small team
  • Annual salary range: $175,000-$240,00 USD

Compensation Philosophy:

We offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks. Actual compensation and offerings will vary based on role, level, and location. Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations.

Benefits

Benefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more.

Similar Jobs

More Jobs at LangChain, Inc

More Enterprise Technology Jobs

Find similar Senior Backend Engineer, LangSmith Deployments jobs: