Principle Software Engineer, AI Observability & Evals Platform

LangChain, Inc

$230K — $270K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 10+ years of experience in backend or fullstack engineering on complex production systems.
  • Strong programming skills in Python and/or Go (backend) and TypeScript, React (frontend).
  • Experience in owning architectural decisions and understanding tradeoffs in systems design.
  • Proven track record with high-throughput or mission-critical systems, focusing on performance and reliability.
  • Experience operationalizing systems from prototype to production and maintaining them at scale.
  • Demonstrated mentoring ability to elevate the technical quality of engineers.
  • Effective communication skills and ability to collaborate with product and design teams.

Responsibilities

  • Lead architectural decisions across Go, Python, and TypeScript stack for scalable systems.
  • Own full stack features from backend services to frontend experiences.
  • Drive tracing, monitoring, and evaluation workflows for reliable systems handling high-volume data.
  • Contribute to product roadmap development by collaborating with product and design teams.
  • Set and uphold engineering standards through code reviews and establishing foundational patterns.
  • Mentor engineers of all levels through constructive feedback and technical guidance.
  • Resolve production issues with a focus on root cause and durable fixes.

Benefits

  • Medical, dental, and vision coverage.
  • Flexible vacation policy.
  • 401(k) plan.
  • Complimentary meals on in-office days in the US.
Full Job Description
About the Team

The LangSmith team owns and builds LangChain's core platform for observability, evaluation, and production reliability of AI systems. From tracing and annotation to run rules, evaluations, and beyond, they own this end-to-end. If you want to help define what great AI observability looks like at production scale, this is where that work gets done.

About the Role

We're looking for a Principal/Lead level Software Engineer to join the LangSmith team and help drive the technical direction of the platform. You'll build across the full stack from backend services and APIs to frontend product surfaces, and you'll play a central role in shaping how we build: setting engineering standards, mentoring engineers across the team, and making architectural decisions that hold up as we scale. If you're energized by both hands-on engineering and the multiplier effect of leveling up those around you, this role is built for that.

Location: This role can be based in our Boston, San Francisco, or NYC office.

What You'll Do

Drive Technical Direction
  • Lead architectural decisions across our Go, Python, and TypeScript stack, ensuring systems are performant, maintainable, and built to scale
  • Work across the full stack, owning features end-to-end from backend services and APIs through to frontend product experiences
  • Drive tracing, monitoring, and evaluation workflows at scale, with a focus on reliability and query performance across high-volume data
  • Help shape the product roadmap by partnering closely with product and design - not just executing on it
Raise the Bar for the Team
  • Set engineering standards for the team: define patterns, lead code reviews, and establish the foundations others build on
  • Mentor and grow engineers at all levels through code review, design feedback, pairing, and ongoing technical guidance
  • Drive projects from ambiguity to delivery while maintaining high engineering standards and aggressive timelines
Own Reliability and Quality
  • Troubleshoot and resolve production issues with a root-cause mindset, and implement durable fixes
  • Ensure system reliability through strong testing, monitoring, and alerting practices
  • Create and maintain technical documentation, including system design docs and API references
What You'll Bring

  • 10+ years of professional experience in backend or fullstack engineering on highly complex, production systems
  • Strong programming skills across multiple parts of the stack: backend (Python and/or Go) and frontend (TypeScript, React, or similar)
  • Demonstrated experience making and owning architectural decisions, including tradeoffs around data systems, APIs, and service reliability
  • Experience with high-throughput or mission-critical systems, and a proven ability to optimize for performance and reliability
  • Depth in operationalizing technical work - you've taken systems from prototype to production and kept them running well at scale
  • Demonstrated track record of mentoring engineers and raising the technical quality of a team, not just the codebase
  • Strong communication skills and comfort operating cross-functionally with product, design, and engineering leadership
  • Customer centricity and an ownership mentality - you care how the product lands, not just how the code reads
  • You exemplify our operating principles


Nice to Have
  • Experience with database systems (Postgres, Redis, ClickHouse) and cloud platforms (AWS, GCP, or Azure)
  • Familiarity with observability tooling, evaluation frameworks, or AI/LLM infrastructure

Salary Range: $230,000 - $270,000

Compensation Philosophy:

We offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks. Actual compensation and offerings will vary based on role, level, and location. Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations.

Benefits

Benefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more.

Similar Jobs

More Jobs at LangChain, Inc

  • Partner Alliance Lead - Federal
    $190K — $270K *
    Washington, DC 20011 (District Of Columbia County)
    Education, Government & Non-Profit
    In-Person
  • Controller
    $200K — $225K *
    New York, NY 10025 (New York County)
    Finance & Insurance
    In-Person
  • Enterprise Account Executive (Minneapolis)
    $300K — $350K *
    Minneapolis, MN 55407 (Hennepin County)
    Enterprise Technology
    In-Person
  • Customer Growth Manager
    $150K — $200K *
    San Francisco, CA 94112 (San Francisco County)
    Enterprise Technology
    In-Person
  • Head of Narratives
    $210K — $230K *
    San Francisco, CA 94112 (San Francisco County)
    Consumer Technology
    In-Person

More Information Technology Jobs

Find similar Principle Software Engineer, AI Observability & Evals Platform jobs: