AI Testing & Delivery Automation Engineer

Branch Metrics

$140K — $160K *
US-AnywhereRemote in Ontario, CA
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 7+ years in software engineering, test automation, or quality engineering
  • Experienced in test automation across multiple layers (API, service, UI)
  • Demonstrated ability to build and scale test frameworks and automation practices
  • Strong knowledge of modern testing tools (Playwright, Karate, API/contract testing, etc.)
  • Proven experience integrating testing into CI/CD pipelines
  • Hands-on coding experience for writing and reviewing test code
  • Effective communication skills for driving team alignment across cross-functional environments

Responsibilities

  • Define and implement testing standards and coverage across the system
  • Shape the end-to-end testing stack by selecting and adapting tools
  • Establish processes for creating, reviewing, executing, and maintaining test scripts
  • Lead adoption of AI-assisted testing to enhance efficiency
  • Collaborate with teams to kickstart testing efforts and ensure independent execution
  • Develop a scalable regression and smoke testing strategy
  • Integrate testing processes into CI/CD pipelines
  • Enhance test environment stability and manage test data
  • Continuously improve test reliability and processes for debugging
  • Establish metrics to measure testing quality and drive improvements
  • Serve as a central advocate for testing best practices across teams

Benefits

  • Comprehensive health and wellness programs
  • Generous paid time off
  • Retirement planning options
  • Annual bonus tied to company goals
  • Equity opportunities for qualifying positions
Full Job Description
About the Group:

We are looking for a senior, hands-on AI-Driven Testing & Delivery Lead to define and scale how testing is done across the organization. This role owns the end-to-end testing approach, from defining what and how we test to implementing tools, integrating testing into CI/CD, and enabling teams to build and maintain reliable automated tests.

You will work closely with Engineering and Product to establish clear standards and ensure testing is part of how we develop and deliver software, not a separate function. This is not a traditional QA role. You will not be the only person writing tests. Instead, you will enable engineering teams to own testing, while providing the frameworks, tools, and guidance to make that successful.

The role is highly hands-on and requires strong technical depth, combined with the ability to drive alignment and adoption across teams. You will also lead the adoption of AI-assisted testing to accelerate test creation, debugging, and maintenance.

What You'll Do:
  • Own, design, and drive how testing is implemented across the system, including standards, coverage, and guardrails: what gets tested, where (API, service, UI), and how it is executed
  • Shape and evolve the testing stack end-to-end (Playwright, Karate, Pact, Postman, etc.), selecting and adapting tools based on what works best for our system
  • Define the approach for creating, reviewing, executing, and maintaining test cases and test scripts, working closely with Engineering and Product
  • Drive adoption of AI-assisted testing (Claude Code, Windsurf, Copilot), using AI to generate test cases and scripts, support debugging and maintenance, and reduce manual effort at scale
  • Work hands-on with teams to get them started, helping define test cases, write initial tests, and ensure teams can continue independently
  • Build and own a scalable regression and smoke testing approach, including test library, reliability, and ongoing maintenance
  • Own the integration of testing into CI/CD pipelines, defining guardrails for execution and deployment gating
  • Work with Engineering and Infrastructure teams to define, establish, and improve test environments, data, and stability
  • Continuously improve test reliability, reduce flakiness, and drive clear processes for test results, debugging, and evolution
  • Define and drive testing metrics (coverage, reliability, execution, failures) to measure quality and guide improvements
  • Drive adoption of testing standards across Engineering and Product, acting as the central point of coordination and champion for quality practices across teams
We're Looking for Someone With:
  • 7+ years of experience in software engineering, test automation, or quality engineering
  • Strong hands-on experience with test automation across multiple layers (API, service, UI)
  • Experience building and scaling test frameworks and automation practices, not just writing tests
  • Strong understanding of modern testing tools and approaches (Playwright, Karate, API/contract testing, etc.)
  • Experience evaluating and adopting modern tools and frameworks based on system needs
  • Experience integrating testing into CI/CD pipelines and working with modern development workflows
  • Ability to design testing strategies, define coverage, and establish standards across teams
  • Hands-on coding experience and ability to write and review test code as needed
  • Experience working closely with Engineering and Product teams in a cross-functional environment
  • Strong communication skills with the ability to drive alignment and adoption across teams
  • Experience improving test reliability, reducing flakiness, and maintaining long-term test quality
  • Experience adopting AI into QA practices, including using tools like Claude Code, Cursor, Windsurf, or Copilot to improve test creation, debugging, and maintenance
  • Comfortable working in fast-moving environments and building processes from scratch

This role is 100% remote in Canada. This role does not qualify for relocation or visa sponsorship.

In accordance with applicable law, the following represents a reasonable estimated compensation range for this role: the estimated pay range for this role, if based in Canada is 140,000 CAD to 160,000 CAD. Please note that this information is provided for those hired in Canada only. Compensation for candidates outside of Canada will be based on the candidate's specific work location. Actual compensation will be determined based on skills, experience, and geographic location and may be more or less than the amount shown above. This role additionally includes a 10% annual bonus tied to company goals.

The salary range provided represents base compensation and does not include potential equity, which is available for qualifying positions. At Branch, we are committed to the well-being of our team by offering a comprehensive benefits package. From health and wellness programs to paid time off and retirement planning options, we provide a range of benefits for qualified employees. For detailed information on the benefits specific to your position, please consult with your recruiter.

Similar Jobs

More Jobs at Branch Metrics

More Information Technology Jobs

Find similar AI Testing & Delivery Automation Engineer jobs: