Commerce Experiences Delivery and Operations team is responsible for CI/CD, end-to-end (E2E) testing infrastructure and operations for Commerce. Our team serves the Commerce Experiences. We build and operate the platforms that let product engineering teams ship with confidence: pipeline orchestration, distributed E2E test execution, flaky-test detection, and the operational tooling that keeps build and test systems fast, reliable, and observable.

We are actively investing in AI as a core engineering discipline for our team, not just as a productivity layer. We're building intelligent platform features, agentic systems, and AI-assisted automation for CI/CD, metrics, and testing infrastructure, and we're looking for engineers who want to go beyond calling AI APIs to engineering the platforms, evaluation systems, and optimization layers underneath the infrastructure that makes AI capabilities reliable, cost-efficient, and usable at scale.

About the Role

We're looking for a Software Engineer (L4) to help build and operate the CI/CD pipelines and test infrastructure that our engineering organization depends on every day. You'll work on well-scoped, meaningful pieces of larger platform initiatives, with guidance and mentorship from senior engineers and your manager while growing your ability to independently own projects end You'll work on well-scoped, meaningful pieces of larger platform initiatives, with guidance and mentorship from senior engineers and your manager, while growing your ability to independently own projects end-to-end.to end.

This role blends software engineering with operations: you'll write code that improves pipeline reliability and test execution, and you'll also be on the front line when builds break, tests flake, the CI/CD system needs troubleshooting or the production system needs observability investments. It's a strong fit for someone who wants to grow into a platform/infrastructure engineering career and enjoys the satisfaction of unblocking other engineers.

We're especially interested in candidates who have strong AI engineering skills with hands-on experience building GenAI-powered tools to solve real operational problems, for example, automating triage of production alerts, summarizing or root-causing incidents, or diagnosing and improving test health across CI/CD systems. If you've shipped an LLM-powered tool that made an on-call rotation, a test suite, or a build pipeline meaningfully better, we want to hear about it.

Key Responsibilities

Primary stack: JavaScript/TypeScript, Java, Python, GitHub Actions. You'll work alongside test frameworks (Jest, Playwright, ) through platform and pipeline integration work - you won't author or maintain product test suites yourself.

• Build and maintain components of our CI/CD pipelines (build orchestration, workflow automation, GitHub Actions) that engineering teams rely on to ship safely and quickly
• Develop and support test execution infrastructure, including test scheduling, distributed run coordination, and results reporting
• Build and ship AI-powered platform features for CI/CD, metrics, and testing infrastructure, agentic systems and AI-assisted automation for problems like alert triage, incident summarization, and test-health diagnostics
• Design and implement the distributed backbone for Commerce Observability agentic AI-driven analysis, inference, and orchestration systems
• Contribute to tooling that detects, quarantines, and helps diagnose flaky tests
• Partner with test-framework and platform teams to integrate new tools and frameworks into the pipeline
• Triage, troubleshoot, and resolve pipeline and test-infrastructure incidents; participate in an on-call rotation for CI/CD and test operations

Must Haves

• 4+ years of professional software engineering experience (or equivalent practical experience)
• Proficiency in at least one of JavaScript/TypeScript, or Java
• Working knowledge of CI/CD tooling such as GitHub Actions, Jenkins, or CircleCI
• Gen AI stack: You have strong interest and experience with the latest GenAI stack (LLMs, RAG, Agents). You have familiarity with AI Observability systems like Braintrust
• You've shipped LLM-powered systems that are near-deterministic, scalable, and monitored in production
• You build and maintain evaluation frameworks, not just features. You know how to measure whether an AI-assisted system (e.g., alert triage, test-health diagnostics) is actually working, and use results to guide design decisions
• You understand model internals and ML methodologies well enough to evaluate and select models with rigor and to recognize when AI is not the right tool for a problem
• Solid understanding of software testing concepts (unit, integration, E2E) and how automated testing fits into a delivery pipeline
• Strong debugging and troubleshooting skills, and comfort working in an operational, on-call context
• Clear written and verbal communication; able to document technical work for other engineers
• Ability to execute well-scoped projects with moderate guidance, and a track record of growing scope and independence over time
• A genuine interest in developer productivity, platform engineering, or testing infrastructure

Nice to Haves

• Experience with E2E or test frameworks such as Playwright, Selenium, Cypress, Jest, or Mocha
• Exposure to distributed tracing/observability tools (Datadog, Honeycomb, Splunk, or similar)
• Hands-on experience with GenAI-assisted developer tooling
• Experience with GraphQL
• Prior experience supporting production systems or an on-call rotation
• Experience working with a globally distributed team

Generally, our compensation structure consists solely of an annual salary; we do not have bonuses. You choose each year how much of your compensation you want in salary versus stock options. To determine your personal top of market compensation, we rely on market indicators and consider your specific job family, background, skills, and experience to determine your compensation in the market range. The range for this role is $250,000.00 - $413,000.00.

Netflix provides comprehensive benefits including Health Plans, Mental Health support, a 401(k) Retirement Plan with employer match, Stock Option Program, Disability Programs, Health Savings and Flexible Spending Accounts, Family-forming benefits, and Life and Serious Injury Benefits. We also offer paid leave of absence programs. Full-time hourly employees accrue 35 days annually for paid time off to be used for vacation, holidays, and sick paid time off. Full-time salaried employees are immediately entitled to flexible time off. See more details about our Benefits here.