Quality Assurance Lead

Analytica

$110K — $130K *
Education, Government & Non-Profit
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 7+ years of experience in software quality assurance or related fields, with leadership in QA strategy for enterprise systems.
  • Proven ability to develop and implement comprehensive QA strategies for complex software and AI platforms.
  • Hands-on expertise in automated testing and various testing methodologies (functional, integration, regression, etc.).
  • Experience testing APIs, databases, web applications, and data pipelines.
  • Demonstrated capability in integrating automated tests within Agile/DevSecOps CI/CD pipelines.
  • Familiarity with data quality validation for data ingestion and analytics.
  • Strong understanding of modern software architectures and tools, including Linux and various databases.

Responsibilities

  • Develop and execute an end-to-end QA strategy covering applications, data pipelines, and AI outputs.
  • Establish and manage test plans, cases, and quality standards across all environments.
  • Lead a range of testing types including functional, security, and user-acceptance testing.
  • Design automated testing frameworks and incorporate them into CI/CD cycles.
  • Work closely with development teams to identify and mitigate quality risks early on.
  • Set up data quality testing to ensure data integrity across workflows.
  • Evaluate AI outputs for accuracy and reliability, ensuring they reflect valid underlying data.

Benefits

  • Competitive compensation with potential bonuses.
  • Employer-paid healthcare benefits.
  • Funding for training and development opportunities.
  • 401k matching contributions.
Full Job Description
We are seeking an experienced Quality Assurance Lead to lead quality planning and testing across software, data pipelines, analytics, AI outputs, accessibility, and deliverables for a Federal data analytics and AI modernization initiative.

The team will deliver a secure, scalable platform that integrates structured and unstructured data, provides data visualization and traceable AI-assisted analytics, and gives examiners centralized tools for search, review, monitoring, and decision support. The platform will support professional judgment and will not replace authoritative agency financial or grants-management systems or execute financial transactions.

We offer competitive compensation with opportunities for bonuses, employer paid health care, training and development funds, and 401k match.

Key Responsibilities
Quality Strategy & Test Engineering
  • Develop and execute an end-to-end QA strategy spanning application functionality, data pipelines, analytics, AI-enabled capabilities, integrations, accessibility, and technical deliverables.
  • Establish test plans, test cases, acceptance criteria, quality gates, and release-readiness standards across development, test, staging, and production environments.
  • Lead functional, integration, system, regression, performance, security, accessibility, usability, and user-acceptance testing.
  • Design and implement automated testing frameworks and integrate automated tests into CI/CD pipelines.
  • Establish appropriate testing approaches for APIs, databases, data ingestion pipelines, user interfaces, and distributed services.
  • Work with developers, data engineers, AI/ML engineers, platform engineers, and product owners to identify defects and quality risks early in the development lifecycle.
  • Data & AI Quality
  • Establish data-quality testing for accuracy, completeness, consistency, validity, timeliness, uniqueness, and data integrity across ingestion and transformation pipelines.
  • Develop validation approaches to ensure data is correctly transformed and represented in downstream analytics, visualizations, reports, and applications.
  • Define testing strategies for analytical models, calculations, business rules, signals, and derived metrics.
  • Establish quality controls for AI/LLM-enabled functionality, including output accuracy, consistency, relevance, traceability, reliability, and appropriate handling of edge cases.
  • Develop repeatable evaluation approaches for AI outputs and identify potential hallucinations, unsupported conclusions, data leakage, or other unacceptable behavior.
  • Validate that AI-generated insights can be traced back to appropriate underlying data and that the platform clearly distinguishes AI-assisted analysis from authoritative source information.
  • Test model and AI-service changes to ensure new versions do not introduce regressions in existing functionality or analytical results.

Required Qualifications
  • 7+ years of experience in software quality assurance, quality engineering, test automation, or a related discipline, with experience leading QA strategy for enterprise systems.
  • Demonstrated experience developing and implementing end-to-end QA strategies for complex software, data, analytics, or AI-enabled platforms.
  • Hands-on experience with automated testing and functional, integration, regression, performance, security, accessibility, and user-acceptance testing.
  • Experience testing APIs, databases, web applications, data pipelines, and distributed services.
  • Experience developing automated tests and integrating them into Agile/DevSecOps CI/CD pipelines.
  • Experience with defect management, root-cause analysis, requirements traceability, test coverage, quality metrics, and release-readiness reporting.
  • Experience developing data-quality validation and testing approaches for data ingestion, transformation, and analytics.
  • Experience testing or evaluating AI/ML or LLM-enabled applications, including validation of AI-generated outputs and analytical results.
  • Understanding of software development lifecycle, Agile methodologies, CI/CD, and modern application architectures.
  • Familiarity with technologies such as Linux, PostgreSQL or Microsoft SQL Server, Java or .NET, Jenkins, self-hosted Azure DevOps, Kubernetes/Rancher, APIs, and open-source AI models.
  • Strong analytical, problem-solving, communication, and technical documentation skills.
  • Ability to work effectively with developers, data engineers, AI/ML engineers, cybersecurity professionals, product owners, and Government stakeholders.
  • U.S. citizenship and ability to obtain and maintain Top Secret eligibility, as required for all contractor personnel supporting the effort.
  • Active Top Secret highly preferred.


Preferred Qualifications
  • Experience supporting Federal financial management, budget execution, grants management, payment systems, award oversight, financial reporting, or financial stewardship is preferred.
  • Experience supporting Federal financial management, grants, payment, or award-oversight platforms.

Similar Jobs

More Jobs at Analytica

  • Principal AI Architect
    $150K — $180K *
    Bethesda, MD 20817 (Montgomery County)
    Education, Government & Non-Profit
    In-Person
  • Senior AI Engineer
    $120K — $145K *
    Bethesda, MD 20817 (Montgomery County)
    Technical Services
    In-Person
  • Lead Full Stack Engineer
    $120K — $145K *
    Bethesda, MD 20817 (Montgomery County)
    Education, Government & Non-Profit
    In-Person
  • Platform Engineer
    $110K — $130K *
    Bethesda, MD 20817 (Montgomery County)
    Technical Services
    In-Person
  • User Experience Lead
    $110K — $130K *
    Bethesda, MD 20817 (Montgomery County)
    Education, Government & Non-Profit
    In-Person

More Education, Government & Non-Profit Jobs

Find similar Quality Assurance Lead jobs: