About the Job:As a Senior Full Stack Engineer on LaunchDarkly's AgentControl team, you'll build critical systems such as the web application that customers interact with on a daily basis and distributed systems that power AI evaluations at scale. These systems enable customers to control, monitor, and optimize their agent's functionality.
LaunchDarkly's AgentControl team is on a mission to manage the complete software development lifecycle for shipping agents to production, from configuring to benchmarking to observing and beyond. AgentControl enables teams to adjust agent behavior without needing a redeploy or code change, while also running experiments, monitoring agents in production, and putting guardrails around AI as usage scales. The product spans offline evals, real-time observability, prompt and workflow optimization, and decision-making around quality, accuracy, relevance, and cost. The AgentControl team has a huge opportunity ahead of it; it's a strategic bet for LaunchDarkly, and we need your help writing the next chapter in our story.
Responsibilities:- Build and maintain scalable backend services, distributed systems, and APIs that power the AgentControl product
- You'll primarily work in Go, Python, and TypeScript and will work directly with other technologies and tools such as AWS, CockroachDB, Datadog, DeepEval, and FastAPI.
- Collaborate with internal stakeholders, including product managers, designers, and other LaunchDarkly engineering teams, to understand real-world challenges and improve GenAI workflows using our own platform.
- Keep up to date with the latest developments in the AI field and in software development best practices
- Continuously optimize the performance, reliability, and scalability of our systems
- Drive architecture and design discussions, offering thoughtful input and collaborating with peer engineers to identify trade-offs and make well-informed decisions
- Take ownership of code in production, participate in on-call rotations, and help improve the reliability and maintainability of our systems over time.
- Support teammates through thoughtful design reviews, knowledge sharing, and informal mentorship.
Qualifications:- 7+ years of professional software engineering experience, with a track record of shipping production-quality full-stack features.
- Understanding of prompt engineering, fine-tuning models, or deploying AI services in production environments.
- Experience with designing, implementing, and maintaining RESTful APIs
- Experience writing production-ready code with emphasis on quality and maintainability
- Experience with distributed systems or data ingestion
- Strong computer science fundamentals
- Committed to working in a communicative, collaborative environment
- Comfortable navigating ambiguous challenges in a rapidly evolving domain, and excited about staying at the forefront of AI advancements
- Strong sense of ownership and accountability for delivering impactful solutions
- Proven ability to work closely with Product and Design teams to define requirements for new features in a fast-paced iterative environment
- Bonus: Hands-on experience building GenAI features, Agents, and/or working with Large Language Models (LLMs), either through direct model integration or leveraging AI APIs like OpenAI, Google Cloud AI, or AWS Bedrock.
Pay:Target pay ranges based on Geographic Zones* for Level 4:
- Zone 1: San Francisco/Bay Area or NYC Metropolitan Area, Boston, Seattle - $187,000 - $257,000**
- Zone 2: Irvine, LA, Monterey, Santa Barbara, Santa Rosa, Austin, Portland, Philadelphia, Chicago - $168,000 - $231,000**
- Zone 3: All other US locations - $158,000 - $218,000**
LaunchDarkly operates from a place of high trust and transparency; we are happy to state the pay range for our open roles to best align with your needs. Exact compensation may vary based on skills, experience, and location.
*Within the United States, our geographic pay zones are defined by counties surrounding major metropolitan areas.
**Restricted Stock Units (RSUs), health, vision, and dental insurance, and mental health benefits in addition to salary.