Zayo

Director, Enterprise Quality Engineering and Agentic Evaluation

Zayo • $126K — $194K *
Enterprise Technology
11 - 15 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science, Engineering, Information Systems, Mathematics, or related field; equivalent experience considered.
  • Minimum of 12 years in quality engineering, software testing, or related fields, with 5+ years in leadership roles.
  • Experience in building modern quality engineering capabilities, focusing on automation and risk-based testing.
  • Strong familiarity with enterprise test automation platforms, especially Tricentis Tosca and qTest.
  • Proven track record in leading quality engineering across multiple products and business units.
  • Deep understanding of various testing methodologies including API, integration, and performance testing.
  • Knowledge of generative AI and responsible AI testing practices.

Responsibilities

  • Define and lead the enterprise quality engineering strategy and governance.
  • Manage the enterprise quality engineering platform and its automation assets.
  • Establish risk-based quality models and release-readiness criteria.
  • Lead centralized quality engineering services for testing across enterprise products.
  • Develop reusable automation frameworks and continuous testing practices.
  • Establish capabilities for AI-agent evaluation and production quality monitoring.
  • Provide independent quality intelligence and risk assessments to stakeholders.
  • Manage vendor relationships for outsourced quality engineering resources.
  • Cultivate a quality engineering culture focused on automation and continuous improvement.

Benefits

  • Excellent Health, Dental & Vision Insurance
  • Retirement 401(k) Savings Plan
  • Generous paid time off policy including paid parental leave
Full Job Description
We are seeking an experienced Director, Enterprise Quality Engineering and Agentic Evaluation to build and lead a modern enterprise quality capability across Zayo's technology organization. This role will be accountable for improving the reliability, predictability, and speed of technology delivery while providing independent assurance for critical business platforms, transformational programs, and AI-enabled solutions.

The successful candidate will combine deep quality engineering expertise with strong enterprise leadership, bringing a risk-based, automation-first approach to how quality is embedded across the software delivery lifecycle. The role will also shape how Zayo evaluates and governs emerging agentic AI capabilities, ensuring they are reliable, controlled, and ready for enterprise-scale adoption.

This is a highly collaborative and transformational leadership role, partnering across Engineering, Product, Architecture, Data and AI, Operations, and business teams to strengthen quality outcomes, reduce production risk, and establish a culture of measurable engineering excellence.

Key Responsibilities
  • Define and lead Zayo's enterprise quality engineering strategy, operating model, roadmap, service catalog, standards, and governance.
  • Own the enterprise quality engineering platform, including Tosca, qTest, automation assets, integrations, test execution infrastructure, quality reporting, and AI-evaluation capabilities.
  • Establish risk-based quality models, release-readiness criteria, quality gates, certification standards, and evidence requirements for critical platforms, business processes, integrations, data products, and AI agents.
  • Lead a centralized quality engineering service that plans, automates, executes, and governs testing across enterprise products, platforms, programs, and high-risk releases.
  • Develop reusable automation frameworks, model-based testing patterns, API and integration testing capabilities, regression suites, and continuous testing practices aligned to business risk and production impact.
  • Establish enterprise capabilities for AI-agent evaluation, including scenario design, evaluation datasets, regression testing, tool-use validation, policy and permission checks, human escalation criteria, and production quality monitoring.
  • Own the enterprise approach to test data, test environments, service virtualization, production validation, and quality analytics to reduce release risk and delivery delays.
  • Provide independent quality intelligence and release-risk assessments to engineering, product, program, and executive stakeholders.
  • Manage vendor-outsourced quality engineering resources, Tricentis partners, systems integrators, and specialist testing providers to deliver sustained enterprise quality outcomes.
  • Build a quality engineering culture focused on automation, objective assurance, reuse, engineering discipline, measurable outcomes, and continuous improvement.


Qualifications
  • Bachelor's degree in Computer Science, Engineering, Information Systems, Mathematics, or a related discipline; equivalent relevant experience may be considered.
  • Minimum of twelve (12) years of experience in quality engineering, software testing, test automation, platform engineering, enterprise technology delivery, or related technology disciplines, including 5+ years leading quality engineering, test automation, enterprise testing, or platform-oriented teams.
  • Demonstrated experience building or leading modern quality engineering capabilities beyond manual test execution, including automation strategy, risk-based testing, continuous testing, quality gates, and release assurance.
  • Strong experience with enterprise test automation and test management platforms, preferably Tricentis Tosca and qTest.
  • Experience leading testing or quality engineering across multiple products, platforms, business processes, programs, or business units.
  • Strong understanding of API, integration, data, workflow, cloud, event-driven, distributed-system, performance, resilience, and production validation testing.
  • Practical knowledge of generative AI, large language models, retrieval, AI agents, tool calling, evaluation methods, and responsible AI testing practices.
  • Strong executive communication, stakeholder management, vendor management, financial management, organizational leadership, and decision-making skills.


Estimated base salary range: $126,600 - $194,700 USD/annually.

Work Authorization Requirement: This position is not eligible for employment-based visa sponsorship. Zayo will not provide, transfer, or assume sponsorship for any employment visa or work authorization for this position now or in the future.

#LI-Remote

The base pay range shown is a guideline and reasonable estimate for this role. It takes into account the wide variety of factors that are considered in making compensation decisions. Actual compensation offered may vary from the posted range based upon geographic location, work experience, skill level, certifications, and other business and organizational needs. Non- sales roles may be eligible to participate in a discretionary annual incentive plan. Sales roles may be eligible to participate in a sales incentive plan.

Additionally, this position may be eligible for certain benefits, such as health insurance, life insurance, disability retirement plans, paid time off.

The posting will be active for a minimum of 3 days. The active posting will continue to extend by 3 days until the position is filled.

Benefits, Rewards & Wellness
  • Excellent Health, Dental & Vision Insurance
  • Retirement 401(k) Savings Plan
  • Generous paid time off policy including paid parental leave


About Zayo

Zayo Group Holdings Inc is a provider of bandwidth infrastructure services, including fiber and bandwidth connectivity, colocation, and cloud infrastructure to a range of businesses. The company operates through its fiber solutions, zColo, and Other segments. Its fiber solutions segment provides bandwidth infrastructure solutions over its fiber-optic network. The zColo segment provides colocation and interconnection services. The Other segment provides network and infrastructure services to customers who are not part of the fiber solutions and zColo segments.
Learn more about Zayo
Size
3,781 employees
Industry
Founded
2007
NASDAQ

Similar Jobs

More Jobs at Zayo

More Enterprise Technology Jobs

Find similar Director, Enterprise Quality Engineering and Agentic Evaluation jobs: