Comcast

Quality Engineering Lead – Agent Evaluation & AI Platforms

Comcast$135K — $203K *
Telecommunications & Hardware
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 10+ years of experience in Software Quality Engineering
  • 2+ years of hands-on experience in Agentic AI validations
  • Deep knowledge of all 4 Comcast Lines of Business
  • Comprehensive understanding of device provisioning lifecycles
  • Strong functional understanding of automation frameworks like Python or TypeScript
  • Power-user proficiency in JIRA and Kibana

Responsibilities

  • Run daily scrums and optimize team velocity
  • Lead defect triaging and ensure rapid closure of high-priority issues
  • Participate in requirement meetings to establish technical 'Definition of Done'
  • Lead User Acceptance Testing and translate technical deployments into business-ready validations
  • Drive strategy for Agent Evaluation techniques within Google ADK environments
  • Conduct technical code reviews for automation repositories
  • Mentor junior engineers on designing comprehensive Test Plans

Benefits

  • Best-in-class benefits package
  • Expert guidance and personalized support for employees and families
  • Support for physical, financial, and emotional well-being
  • Access to tools for navigating major life milestones
Full Job Description

Job Summary

We are seeking seasoned Quality Lead (SDET 4) to orchestrate our enterprise release cycles and lead the quality strategy for our next-generation AI initiatives. This role is designed for a strategic technical leader who combines deep Comcast domain expertise across all 4 Lines of Business (LOBs) and Device Provisioning with specialized experience in Agentic AI validations.

You will lead the quality process from the front: running scrums, managing the end-to-end defect lifecycle, conducting structural code reviews, and serving as the principal architect for our Agent Evaluation strategies within Google ADK environments.

The AI Agentic Team designs, builds, and runs intelligent agents end to end. We own agent logic, workflows, integrations, production deployment, and ongoing performance. By combining build and operations, we deliver agentic systems that are reliable, secure, and scalable in real-world use.

Job Description

High-Impact Leadership & Process Ownership

  • Agile Governance: Run daily Scrums and stand-ups, optimizing team velocity, managing task assignments, and ensuring delivery milestones are met on time.

  • Defect Triaging: Lead rigorous defect triaging meetings. You will be the primary driver tracking high-priority issues, coordinating directly with development teams, and pushing defects to rapid closure.

  • Requirement & Architecture Inception: Embed yourself in upstream requirement meetings. You will challenge assumptions, identify missing edge cases, and establish the technical "Definition of Done."

  • Business & UAT Orchestration: Act as the strategic partner to Business teams, leading User Acceptance Testing (UAT) and translating complex technical deployments into business-ready validation.

AI Governance & Agent Evaluation Strategy

  • Agentic AI Expertise: Bring at least 2+ years of hands-on experience in Agentic AI validations, navigating the non-deterministic nature of large language models and intelligent workflows.

  • Evaluation Frameworks: Drive the strategy for Agent Evaluation techniques, ensuring the team effectively implements automated verification patterns (such as LLM-as-a-judge) within Google ADK environments.

  • Prompt Engineering Oversight: Apply deep knowledge of Prompt Engineering to validate agent behavior, test fallback mechanisms, and ensure intent optimization.

  • Quality Governance & Code Reviews: Conduct technical Code Reviews for the team's automation repositories. Ensure that Python or TypeScript test scripts targeting the AI layers are modular, efficient, and scale effectively.

Comcast LOB, Provisioning & Quality Governance

  • Full LOB Coverage: Apply deep operational knowledge across all 4 Comcast LOBs (Xfinity Video, High-Speed Data, Digital Voice, and Xfinity Mobile) to ensure cross-functional workflows are flawlessly validated.

  • Device Provisioning Master: Leverage an intricate understanding of backend Device Provisioning pipelines, activation flows, and equipment states to isolate complex environments and system-level issues.

  • Automation Oversight & Code Reviews: Maintain strong technical oversight of the team's codebase. You will possess a solid understanding of test automation methodologies and basic knowledge of testing frameworks to conduct structural Code Reviews, ensuring the automation scripts meet quality, maintainability, and scalability standards.

  • E2E Strategy & Mentorship: Guide junior engineers in designing comprehensive Test Plans and Strategies. You will define what to test and how to test it, ensuring total coverage of complex subscriber journeys.

Execution, Observability & Reporting

  • Technical Troubleshooting: Navigate Kibana logs and system metrics independently to perform deep-dive root cause analysis on failures before handing them off to development.

  • Custom JIRA Architecture: Build and manage advanced JIRA dashboards to visualize real-time quality trends, escape-defect rates, and overall sprint health for leadership.

  • Executive Reporting:Prepare and present Daily and Weekly Status Reports to stakeholders, providing absolute transparency on risks and release readiness

Required Experience & Skill Set

  • Leadership Track: 10+ years of experience in Software Quality Engineering, with a seasoned background in managing large-scale delivery and leading functional testing strategies.

  • AI Specialization: 2+ years of specific experience with Agentic AI validations, Prompt Engineering, and Agent Eval techniques (specifically with Google ADK or similar models).

  • Comcast Domain Mastery: Deep, demonstrable knowledge of all 4 Comcast LOBs and their underlying technical architectures. (asIS)

  • Provisioning Infrastructure: Comprehensive understanding of the functional lifecycle for device provisioning, including complex billing system (ACSR and AMDOCS) handoffs and activation workflows.

  • Automation & Framework Literacy: Strong functional understanding of automation frameworks (e.g., Python, TypeScript), providing the technical insight necessary to oversee code quality and ensure automated suites align with business requirements.

  • Process Tooling: Power-user proficiency in JIRA for advanced dashboarding and Kibana for deep-dive log analytics to drive data-driven quality decisions.


Disclaimer: This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.

Skills

Adaptability, Agentic AI, AI Agent Orchestration, AI Platforms, Critical Thinking, Test Automation

Compensation

Primary Location Pay Range: $135,683.35 - $203,525.03

Comcast intends to offer the selected candidate base pay within this range, dependent on job-related, non-discriminatory factors such as experience. The application window is 30 days from the date job is posted, unless the number of applicants requires it to close sooner or later.

Base pay is one part of the Total Rewards that Comcast provides to compensate and recognize employees for their work.    Most sales positions are eligible for a Commission under the terms of an applicable plan, while most non-sales positions are eligible for a Bonus.  Additionally, Comcast provides best-in-class Benefits to eligible employees.  We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most.  That’s why we provide an array of options, expert guidance and always-on tools, that are personalized to meet the needs of your reality – to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the on our careers site for more details.

Education

Bachelor's Degree

While possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.

Certifications (if applicable)

Relevant Work Experience

7-10 Years

About Comcast

FreeWheel manages the economics of content for the enterprise class of entertainment, offering technical infrastructure for revenue rights management and business operations, wrapped in advisory services. They offer advertising sales rights, display, video, mobile ad management, contract management, professional content, ad serving, reporting, analytics, technology, services, advisory services, business operations, programmatic advertising, advertising marketplace, and linear, and online advertising.

Comcast Careers

Joining Comcast means becoming part of a dynamic team committed to shaping the future of media and technology. As a leading company in entertainment, communications, and technology, Comcast offers unparalleled job opportunities designed to foster professional growth and innovation. Work You’ll Do At Comcast, you’ll be part of a culture that cherishes diversity, leadership, and innovation. Our team is at the forefront of the industry, leading changes that redefine how people connect and experience content across the globe. Transform your career with a company that is committed to your professional development. Comcast offers a variety of positions across multiple fields, where your skills will be honed for leadership roles and your career aspirations supported by comprehensive training programs. Join Our Leading Team Be part of a team that values creativity and diversity. Comcast’s commitment to inclusive culture and diversity training ensures that every team member’s voice is heard and valued. This approach not only enhances our work environment but also drives our leadership in the competitive tech industry. Innovate with Us Engage in work that matters with a team of over 100,000 employees worldwide. At Comcast, innovation isn’t just another buzzword—it's at the core of everything we do. From developing groundbreaking technology to reimagining how our customers experience entertainment and communication, your work will influence millions. Internship and Employment Opportunities Start your career with a Comcast internship, where you’ll gain invaluable industry experience, network with professionals, and develop skills that will benefit you throughout your career. For those seeking full-time positions, Comcast’s hiring process is designed to find not just the right skills but the right fit for our culture of growth and innovation. Benefits and Growth Comcast is dedicated to the well-being and advancement of our team members. Enjoy a wealth of benefits that support both your professional and personal life, including health, wellness, and retirement plans. Our employees are encouraged to pursue continuous growth through professional development opportunities and leadership training. Stay Connected Join the Comcast Team Explore job opportunities that match your skills and interests. We are always looking for passionate, curious, and solution-driven team players. Search Comcast jobs today and find out where your career could take you. Keep Up to Date Stay ahead with career tips, insider perspectives, and industry-leading insights you can put to use today—all from the people who work here. Read Careers Blog Job Alert Emails Customize your subscription to receive job alerts, latest news, and insider tips tailored to your preferences. Discover the exciting and rewarding career opportunities that await at Comcast. By joining Comcast, you’re not just finding a job—you’re joining a community of innovators who are passionate about creating extraordinary experiences for our customers and for each other.
Learn more about Comcast
Size
31,000 employees
Market Cap
$149.9 billion
Industry
Net Income
$10.5 billion
Founded
1963
5 Year Trend
+7.6%
Revenue
$103.5 billion
NASDAQ

Similar Jobs

More Jobs at Comcast

More Telecommunications & Hardware Jobs

Find similar Quality Engineering Lead – Agent Evaluation & AI Platforms jobs: