OneDigital

AI Quality Assurance Analyst - Remote

OneDigital$100K — $110K *
US-AnywhereRemote in United States
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience in QA or quality-focused roles, with exposure to AI or LLM products preferred
  • Strong ability to evaluate AI-generated outputs for quality, accuracy, and appropriateness
  • Familiarity with prompt-driven systems and knowledge of potential model failures
  • Experience in writing test cases and documenting defects clearly
  • Comfortable in no-code and low-code environments
  • Excellent written communication skills to describe issues precisely
  • Curiosity and adaptability in fast-paced, emerging tech environments

Responsibilities

  • Design and execute test plans for AI-powered applications
  • Evaluate AI responses for accuracy and consistency, including handling edge cases
  • Test application workflows and UI behavior across various tools
  • Document and track defects using issue tracking tools like Jira
  • Collaborate with AI Builders to define quality standards for features
  • Maintain repeatable test cases and QA documentation as products evolve
  • Conduct regression testing and identify quality risks early in the build process

Benefits

  • Health and wellbeing benefits
  • Retirement and financial benefits
  • Paid time off
  • Overtime pay for non-exempt employees
  • Learning and development programs
  • Reimbursement for job-related expenses
  • Employee perks and discounts
Full Job Description

Our Newest Opportunity: 

OneDigital | Product Team
No other company in our industry is supercharging the way they work and serve their clients like OneDigital. Fresh thinking has always been the core of OneDigital’s vision and growth strategy. It’s how we stand out in our industry, it’s how we stay competitive and resilient in a changing world. Most importantly, our innovative approach is helping more people do their best work and live their best lives. Innovation fuels our employee experience by making it easier to do your best work anytime, anywhere and from any device. And our tech-based products for clients are a game changer in our industry. If you thrive on change and innovation, OneDigital is the career choice for you.

Our Newest Opportunity
OneDigital is seeking a detail-oriented and curious AI Quality Assurance Analyst to join our embedded product team. This role is responsible for ensuring that the AI-powered applications built by our product team are reliable, accurate, and ready for real-world use across OneDigital’s business lines.

As AI becomes core to how we work and serve clients, quality assurance takes on a new dimension. This is not just about catching bugs. It is about evaluating how AI behaves: whether it responds accurately, handles edge cases gracefully, and delivers a consistent experience for users. You will partner closely with our Principal Engineer, AI Builders, and Product Managers to test both the AI output layer and the application functionality built around it. This is a hands-on individual contributor role for someone who is methodical, curious, and excited about the frontier of AI product development.

Essential Duties and Responsibilities

  • Design and execute test plans for AI-powered applications across both output quality and functional behavior

  • Evaluate AI responses for accuracy, consistency, hallucination, and edge case handling

  • Test application workflows, UI behavior, and integrations across internal and client-facing tools

  • Identify, document, and track defects using standard issue tracking tools (e.g., Jira or equivalent)

  • Partner with AI Builders and Product Managers to define acceptance criteria and quality standards for AI features

  • Develop and maintain repeatable test cases and QA documentation as AI applications evolve

  • Conduct regression testing as applications are updated or new features are released

  • Collaborate with the Principal Engineer and product team to surface quality risks early in the build process

  • Contribute to defining what “good” looks like for AI output quality at OneDigital, helping shape internal QA standards for LLM-based applications

  • Support testing across multiple business lines including Employee Benefits, Retirement, Wealth, and P&C

What You Will Work On

  • AI-powered tools built for internal productivity and workflow automation

  • Client-facing AI applications across OneDigital’s business lines

  • Applications built on modern LLM APIs, including prompt-driven and agent-based workflows

  • A growing library of AI products created by an embedded team of Product Managers and AI Builders

Qualifications, Skills and Requirement

  • Experience in a QA, testing, or quality-focused role, with some exposure to AI or LLM based products preferred

  • Strong ability to evaluate AI-generated outputs for quality, accuracy, and appropriateness

  • Familiarity with prompt-driven systems and an intuition for how language models can fail or produce unexpected results

  • Experience writing and executing test cases and documenting defects clearly

  • Comfort working in no-code and low-code environments

  • Strong written communication skills, with the ability to describe issues precisely and concisely

  • Curiosity and adaptability in a fast-moving, emerging technology space

  • Ability to work independently and manage multiple testing workstreams at once

Education, Training and Experience

  • Bachelor’s degree or equivalent experience

  • Prior experience in a QA role within a software, SaaS, or technology-adjacent environment

  • Exposure to AI or LLM-based tools, either professionally or through independent exploration

  • Familiarity with issue tracking tools (e.g., Jira, Linear, or similar)

  • Understanding of AI governance, data privacy, and responsible AI considerations

The typical base pay range for this role nationwide is $100,000 to $110,000 per year. 

Your base pay is dependent upon your skills, education, qualifications, professional experience, and location. In addition to base pay, some roles are eligible for variable compensation, commission, and/or annual bonus based on your individual performance and/or the company’s performance.  We also offer eligible employees health, wellbeing, retirement, and other financial benefits, paid time off, overtime pay for non-exempt employees, and robust learning and development programs. You will receive reimbursement of job-related expenses per the company policy and may receive employee perks and discounts.

To learn more, visit:  

About OneDigital

OneDigital is a leading insurance brokerage and benefits administration company in the United States. The company was founded in 2000 and is headquartered in Atlanta, Georgia. OneDigital offers a wide range of insurance products and services, including health, dental, vision, life, disability, and voluntary benefits. The company serves clients in a variety of industries, including technology, healthcare, manufacturing, and retail. OneDigital has been recognized as one of the fastest-growing companies in the United States by Inc. Magazine and has received numerous awards for its innovative approach to employee benefits.
Learn more about OneDigital
Size
2,000 employees
Industry
Founded
2000

Similar Jobs

More Jobs at OneDigital

More Information Technology Jobs

Find similar AI Quality Assurance Analyst - Remote jobs: