Datadog

Senior Software Engineer - Bits AI SRE

Datadog$187K — $240K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience in backend engineering, preferably in Go or similar languages.
  • Strong familiarity with LLM-based systems in production.
  • Experience in prompt engineering and iterative improvement for AI models.
  • Solid fundamentals in engineering to build reliable AI systems.
  • Ability to thrive in fast-paced, ambiguous environments, focusing on quick prototyping and deployment.
  • Proven collaboration skills with cross-functional teams across product, design, and engineering.
  • Demonstrated use of AI coding tools and ability to refine AI-generated outputs.

Responsibilities

  • Collaborate with cross-functional teams to design and develop AI-powered product experiences.
  • Engineer customer-facing systems that streamline production issue resolution.
  • Implement backend solutions to ensure reliable and useful applied AI workflows.
  • Rapidly prototype and iterate to enhance product capabilities based on real-world feedback.
  • Create the necessary infrastructure to link AI outputs to actionable remediations.
  • Partner with various teams to expand remediation functionalities and integrate with relevant systems.
  • Stay updated on LLM prompting and applied AI development to inform practical implementations.

Benefits

  • Opportunity to develop tools that enhance software engineering processes.
  • Significant influence on product direction and business impact.
  • Collaborative work environment with supportive and knowledgeable colleagues.
  • Access to competitive global benefits and continuous professional development.
Full Job Description
We're a new team building AI-assisted product experiences that help Datadog customers go from investigation to action, by enabling conversational workflows, guided remediations, and codefixes that address the root cause of production issues.

We're looking for a product-minded engineer to help us quickly define and ship applied AI experiences across chat, remediations, and codefixes. This role sits at the intersection of backend engineering, product development, and prompt engineering, with a strong emphasis on building reliable, production-quality AI systems.

What You'll Do:
  • Work closely with product managers, designers, and engineers to build and iterate on AI-powered product experiences in Bits AI SRE.
  • Develop customer-facing systems across chat, remediations, and codefixes that help users resolve production issues more quickly.
  • Work on prompts, evaluation loops, and backend systems to make applied AI workflows reliable, useful, and production-ready.
  • Prototype quickly, test what works in the real world, and iterate rapidly to ship new product capabilities.
  • Build the infrastructure and product logic needed to connect AI outputs to meaningful actions, including operational remediations and generated code changes.
  • Collaborate with partner teams across Datadog to expand remediation capabilities and integrate with systems that support investigation, automation, and code generation.
  • Follow the latest developments in LLM prompting, agent design, and applied AI product development, and bring strong judgment about what is practical to use in production.


Who You Are:
  • You're an engineer with at least 5 years of professional experience, with strong backend engineering skills and a product mindset. You have experience building production systems in Go (or similar) and have worked with LLM-based systems in practice.
  • You are excited about applied AI and motivated by building product experiences that help users take meaningful action, not just generate insights.
  • You have experience with prompt engineering, evaluation, and iteration for LLM-powered systems, and know how to improve quality through experimentation and feedback.
  • You have strong engineering fundamentals and can build the systems needed to productionize AI features, including integrating model behavior into reliable user-facing products.
  • You are comfortable operating in a fast-moving environment with high ambiguity, and enjoy prototyping, learning quickly, and shipping early versions of new ideas.
  • You collaborate well with cross-functional partners and can work effectively with product, design, and engineering to shape both the user experience and the technical implementation.
  • You care about product quality and user outcomes, and can balance speed with pragmatism when building new AI-powered workflows.
  • Bonus: you have experience with Kubernetes or systems related to production remediation and operational automation.
  • Requirement - Demonstrated ability to use AI coding tools in day-to-day workflows and validate, critique, and refine AI-generated output.
  • Plus - You're motivated to push the boundaries of how AI can improve software engineering best practices and contribute to building AI-enabled products.

Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you're passionate about technology and want to grow your skills, we encourage you to apply.

Benefits and Growth:

  • Get to build tools for software engineers, just like yourself. And use the tools we build to accelerate our development.
  • Have a lot of influence on product direction and impact on the business.
  • Work with skilled, knowledgeable, and kind teammates who are happy to teach and learn.
  • Competitive global benefits.
  • Continuous professional development.


Benefits and Growth listed above may vary based on the country of your employment and the nature of your employment with Datadog.

To conform to US export control regulations, candidates should be eligible for any required authorizations from the US government. This job is available in various departments within our company; to conform to US export control regulations, some of these roles may require candidates to be eligible for any required authorizations from the US government.

#LI-Hybrid

Datadog offers a competitive salary and equity package, and may include variable compensation. Actual compensation is based on factors such as the candidate's skills, qualifications, and experience. In addition, Datadog offers a wide range of best in class, comprehensive and inclusive employee benefits for this role including healthcare, dental, parental planning, and mental health benefits, a 401(k) plan and match, paid time off, fitness reimbursements, and a discounted employee stock purchase plan.

The reasonably estimated yearly salary for this role at Datadog is:

$187,000-$240,000 USD

About Datadog

Datadog is a monitoring and analytics platform for cloud-scale infrastructure and applications. The company was founded in 2010 by Olivier Pomel and Alexis Lê-Quôc and is headquartered in New York City. Datadog's platform assists organizations in improving agility, increasing efficiency, and providing end-to-end visibility across dynamic or high-scale infrastructures. The company's SaaS-based data analytics platform integrates and automates infrastructure monitoring, application performance monitoring, and log management to provide unified, real-time observability of customers' entire technology stack. Datadog's customers include Airbnb, Twilio, and The Washington Post.
Learn more about Datadog
Size
3,200 employees
Market Cap
$22.5 billion
Industry
Net Income
-$24.5 million
Founded
2010
Revenue
$603.4 million
NASDAQ

Similar Jobs

More Jobs at Datadog

More Information Technology Jobs

Find similar Senior Software Engineer - Bits AI SRE jobs: