AstraZeneca

Test Engineering Leader - Evinova

AstraZeneca$165K — $217K *
Healthcare
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor’s degree in Computer Science, Computer Engineering, Mathematics, Information Science, or related field (or equivalent experience).
  • 10+ years of hands-on software test engineering experience across the full stack (UI, API, data).
  • Demonstrated ability to lead test strategy and mentor other engineers, formally or informally.
  • Strong automation skills with frameworks like Playwright, Selenium, or Cypress, and proficiency in Python or similar languages.
  • Experience with REST API testing, database validation (PostgreSQL, MongoDB), and CI/CD test pipelines.
  • A data-driven quality approach with ability to define metrics and use evidence for decision making.

Responsibilities

  • Design and own end-to-end test strategies for products utilizing LLMs and generative AI.
  • Develop frameworks for evaluating LLM output quality and verifying RAG retrieval accuracy.
  • Select and enhance testing tools and frameworks with engineering leadership.
  • Transition testing processes from manual to automated with measurable metrics.
  • Accountable for QA across all releases of multiple products.
  • Build and maintain automation frameworks that align with fast release cycles.
  • Analyze test results, identify trends, and provide actionable insights for improvements.

Benefits

  • 401(k) plan with qualified retirement program.
  • Paid vacation and holidays.
  • Paid leaves for various circumstances.
  • Health benefits including medical, dental, and vision coverage.
Full Job Description

About the Role

Evinova is building AI-native products that are reshaping how clinical trials are designed, documented, and delivered. Our AI-native product suite include Study Designer, Study Document Assistant, AI Document Authoring, and Pipeline Management and put large language models, intelligent automation, and human-centered design directly into the hands of clinical researchers and life-sciences professionals.

We’re looking for a Test Engineering Leader who is equal parts strategist and practitioner—someone who can define how we validate AI-powered software at scale, then roll up their sleeves and prove it works. You’ll own quality across multiple products, shape the testing culture for cross-functional squads, and pioneer approaches to challenges that simply didn’t exist a few years ago: evaluating LLM outputs, validating RAG pipelines, and ensuring AI-generated content meets regulatory expectations in a GxP environment.

If you’ve been waiting for a role where deep test engineering craft meets the frontier of AI—and where your work genuinely improves patient outcomes—this is it.

What You'll Do:

Shape Testing Strategy for AI-Native Products
  • Design and own end-to-end test strategies—automated and manual—for products that integrate LLMs, generative AI, and complex data pipelines.

  • Develop novel evaluation frameworks for LLM output quality, prompt regression testing, and RAG retrieval accuracy.

  • Select, implement, and continuously improve testing tools and frameworks in collaboration with engineering leadership and platform excellence teams.

  • Drive a measurable shift from manual to automated testing, with clear metrics to track progress.

Own Quality and Release Readiness
  • Be the single point of accountability for testing across all releases of your two products.

  • Build and maintain automation frameworks and scripts that keep pace with rapid release cycles.

  • Analyse test results, spot trends, and turn data into actionable improvements—not just reports.

  • Prepare release-readiness documentation and quality artifacts that satisfy both internal stakeholders and GxP compliance requirements.

Lead, Coach, and Build Culture
  • Partner with engineering managers, scrum masters, and delivery leads across squads and geographies to establish a shared quality vision.

  • Lead external contract test engineering squads by influence—setting standards, mentoring team members, and modelling engineering excellence.

  • Champion a quality-engineering mindset: everyone ships quality, not just the test team.

  • Stay hands-on—write test cases, debug failures, and pair with engineers when the situation calls for it.

What You Bring:

Essential Skills and Experience
  • Bachelor’s degree in Computer Science, Computer Engineering, Mathematics, Information Science, or a related field (or equivalent practical experience).

  • 10+ years of hands-on software test engineering experience across the full stack (UI, API, data).

  • Proven ability to lead test strategy and mentor other test engineers—whether through formal management or technical leadership.

  • Strong automation skills with modern frameworks such as Playwright, Selenium, or Cypress, plus scripting fluency in Python or a comparable language.

  • Solid experience with REST API testing, database validation (PostgreSQL, MongoDB, or similar), and CI/CD-integrated test pipelines.

  • A data-driven approach to quality: you define metrics, instrument dashboards, and use evidence to drive decisions.

Highly Preferred

  • Experience testing AI/ML-powered products—especially LLM evaluation, prompt testing, RAG validation, or output-quality benchmarking.

  • Familiarity with GxP software validation, computerised system validation (CSV), or regulated-industry quality practices.

  • Background in life sciences, health-tech, or clinical-trial technology.

  • Experience working with geographically distributed teams and external vendor squads.

SO, WHAT’S NEXT?

To be considered for this exciting opportunity, please complete the full application on our website at your earliest convenience – it is the only way that our Recruiter and Hiring Manager can know that you feel well qualified for this opportunity.  If you know someone who would be a great fit, please share this posting with them.

Where can I find out more?

  • Explore what we’re building:
  • Stay connected and see our impact in action:

Apply today to bring smarter, faster clinical trials to life!

#LI-Hybrid

The annual base pay for this position ranges from $165,656.80- $217,424.55 USD. Base pay offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience. 

In addition, our positions offer a short-term incentive bonus opportunity; eligibility to participate in our equity-based long-term incentive program. Benefits offered included a qualified retirement program [401(k) plan]; paid vacation and holidays; paid leaves; and, health benefits including medical, prescription drug, dental, and vision coverage in accordance with the terms and conditions of the applicable plans.

Additional details of participation in these benefit plans will be provided if an employee receives an offer of employment. If hired, employee will be in an “at-will position” and the Company reserves the right to modify base pay (as well as any other discretionary payment or compensation program) at any time, including for reasons related to individual performance, Company or individual department/team performance, and market factors. 

Date Posted

10-Jun-2026

Closing Date

29-Jun-2026

About AstraZeneca

AstraZeneca is a British-Swedish multinational pharmaceutical company that specializes in the research, development, and manufacturing of prescription drugs. The company was formed in 1999 through the merger of Astra AB and Zeneca Group plc. AstraZeneca's products are used to treat a wide range of medical conditions, including cancer, cardiovascular disease, respiratory disease, and diabetes. The company has operations in over 100 countries and employs more than 76,000 people worldwide. AstraZeneca is committed to developing innovative medicines that improve the health and well-being of people around the world.
Learn more about AstraZeneca
Size
83,100 employees
Market Cap
$211.5 billion
Industry
Net Income
$3.1 billion
Founded
1999
5 Year Trend
+10.2%
Revenue
$26.6 billion
NASDAQ

Similar Jobs

More Jobs at AstraZeneca

More Healthcare Jobs

Find similar Test Engineering Leader - Evinova jobs: