NVIDIA Corporation

AI Quality and Agent Operations Analyst - AI Solutions

NVIDIA Corporation$124K — $195K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 2+ years in software quality, application operations, data analysis, AI or machine learning, technical support, or business analysis.
  • Experience in testing, evaluating, and monitoring applications during development or production phases.
  • Familiarity with generative AI, machine learning concepts, APIs, and enterprise software.
  • Ability to analyze test results and application metrics to identify issues and opportunities.
  • Strong attention to detail with experience in developing test cases, assessment criteria, and quality reports.
  • Effective collaboration skills with technical and business teams.
  • Capacity to manage multiple priority tasks and support production readiness activities.

Responsibilities

  • Collaborate with application teams to standardize AI evaluation and quality assurance processes.
  • Establish test scenarios and quality metrics to ensure consistent evaluations.
  • Evaluate AI outputs for accuracy, relevance, consistency, and alignment with business needs.
  • Analyze evaluation results and user feedback to maintain application quality.
  • Investigate performance trends and communicate findings to technical teams for improvements.
  • Support production launches through testing, monitoring, and quality checks.
  • Develop datasets and documentation to facilitate ongoing improvement.

Benefits

  • Opportunity to work on innovative AI solutions across production phases.
  • Collaboration with skilled team members in a critical operational area.
  • Development of evaluation methods that enhance application quality.
  • Engagement in meaningful projects impacting business functions.
  • Support for professional development through exposure to cutting-edge AI and machine learning technologies.
Full Job Description
AI Quality & Operations Analyst to join our dedicated team and play a crucial role in improving Sales AI applications. This position offers the opportunity to work on innovative AI solutions as they move from development into production. You will collaborate with skilled team members to establish consistent evaluation, quality assurance, and operational practices across WWFO!

What you'll be doing:
  • Collaborate with application teams to replace ad hoc testing with consistent AI evaluation and quality assurance standards and workflows.
  • Help establish test scenarios, assessment standards, quality metrics, and acceptance thresholds.
  • Evaluate AI outputs for accuracy, relevance, consistency, safety, and alignment with business workflows.
  • Analyze evaluation results, service metrics, production data, and user feedback to monitor application quality.
  • Investigate failures, contributing factors, recurring patterns, and performance trends. Collaborate with technical teams on prioritized improvements and communicate findings to technical and business teams.
  • Support production readiness and launches through testing, validation, documentation, monitoring, issue tracking, and quality checks before and after launch.
  • Develop evaluation datasets, test scenarios, quality reports, and operational documentation that support continuous improvement.
  • Assess risks from AI-generated outputs and downstream actions. Identify when additional controls, testing, or human review are needed.


What we need to see:
  • 2+ years of experience in software quality, application operations, data analysis, AI or machine learning, technical support, business analysis, or a related field.
  • Experience testing, evaluating, monitoring, or supporting applications in development or production.
  • Familiarity with generative AI, machine learning concepts, APIs, data workflows, or enterprise software.
  • Experience analyzing test results, application metrics, user feedback, or other data to identify issues and opportunities.
  • Solid attention to detail and experience developing structured test cases, evaluation criteria, documentation, or quality reports.
  • Ability to collaborate effectively with Engineering, Product, Data, Solution Architecture, and business teams.
  • Ability to prioritize multiple assignments and support time-sensitive production readiness and launch activities.
  • A bachelor's degree or equivalent experience in Computer Science, Engineering, Data Science, Information Systems, or a related technical field is encouraged.


Ways to stand out from the crowd:
  • Background with generative AI applications, AI assistants, retrieval-augmented generation, agentic workflows, prompt evaluation, model behavior, hallucination detection, or responsible AI practices.
  • Experience developing evaluation datasets, benchmarks, test harnesses, quality scorecards, or automated testing approaches.
  • Experience with Python, SQL, APIs, dashboards, data analysis, or quality monitoring tools.
  • Background with enterprise application launches, incident management, post-launch operations, observability, service metrics, root-cause analysis, or operational troubleshooting.


Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 124,000 USD - 195,500 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until August 31, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

About NVIDIA Corporation

Nvidia, a global leader in graphics, gaming, and AI technology, offers Nvidia careers and internship opportunities for those passionate about driving innovation in the tech industry. you'll find a company committed to growth, teamwork, and leadership in computer science and machine learning domains.

About Nvidia

A Pioneer in Technology and Innovation

Nvidia has cemented its reputation as a powerhouse in developing advanced graphics processing units (GPUs) and has significantly contributed to the gaming industry's evolution. Moreover, its foray into AI and machine learning has opened new frontiers in technology, making Nvidia a beacon of innovation and a desirable workplace for ambitious tech professionals.

Job Opportunities

Diverse Positions in a Dynamic Field

Nvidia is continuously on the lookout for talented individuals across various domains, including hardware and software engineering, product design, marketing, and sales. Employment opportunities at Nvidia are vast, catering to a wide range of expertise and career aspirations.

Employment in Hardware and Graphics

For those fascinated by the intricacies of hardware and graphics technology, Nvidia offers positions that sit at the forefront of gaming and computing advancements.

Growth in Machine Learning and AI

Nvidia's leadership in AI and machine learning has created numerous vacancies for specialists eager to contribute to groundbreaking projects.

Recruitment in Computer Science

With the constant demand for innovation, Nvidia's recruitment efforts focus on computer science experts capable of pushing the boundaries of what's possible.

Internship Program

Opening Doors to Future Innovators

Nvidia's internship program is designed to nurture the next generation of technology leaders, offering hands-on experience in a culture that celebrates creativity and teamwork.

Benefits and Culture

Interns at Nvidia enjoy a plethora of benefits, from competitive stipends to mentorship opportunities, all within an environment that values growth and learning.

Opportunities for Students

Whether you're an undergraduate, a master's student, or a Ph.D. candidate, Nvidia's internships provide a real-world glimpse into the tech industry, offering valuable experience in various technology fields.

Pathways to Full-Time Employment

Many interns have transitioned into full-time positions, marking the start of successful careers at Nvidia. The internship program is more than a stepping stone into the company; it’s an investment in the professional development of interns. The goal is to ensure that interns are well-equipped for future challenges.

Nvidia Careers: More Than Just a Job

Nvidia offers more than just a job to its employees; it provides a front-row seat on the journey into the future of technology. Nvidia stands as a pillar of innovation with its vast opportunities in hardware, graphics, gaming, machine learning, and computer science. Nvidia careers serve as a launching pad for talented workers who aim to redefine the technological landscape. Whether through full-time positions or internships, joining Nvidia means contributing to a legacy of breakthroughs and becoming part of a global community dedicated to pushing the boundaries of what's possible.
Learn more about NVIDIA Corporation
Size
22,473 employees
Market Cap
$350.4 billion
Industry
Net Income
$4.3 billion
Founded
1993
5 Year Trend
+31.3%
Revenue
$16.6 billion
NASDAQ

More Jobs at NVIDIA Corporation

More Information Technology Jobs

Find similar AI Quality and Agent Operations Analyst - AI Solutions jobs: