Data Scientist - Responsible AI

Empower$87K — $123K *
US-AnywhereRemote in United States
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Data Science, Computer Science, Statistics, Mathematics, Psychology, Economics, Operations Research, or another quantitative discipline.
  • 2 to 5 years experience in data science, statistical analysis, AI evaluation, applied research, or analytics.
  • Strong Python programming skills and experience with data analysis and AI evaluation tools.
  • Strong SQL skills and experience with large, complex datasets.
  • Experience evaluating generative AI applications, large language models, or other AI-enabled solutions.
  • Knowledge of Responsible AI concepts like fairness, bias, and explainability.

Responsibilities

  • Apply statistical analysis and experimentation to evaluate AI applications.
  • Develop and maintain Responsible AI measures, benchmark datasets, and evaluation criteria.
  • Evaluate AI systems on fairness, explainability, transparency, and related metrics.
  • Use evaluation results to support the design and assessment of AI applications.
  • Establish performance baselines and monitor changes in model behavior.
  • Design and execute proofs of concept for new AI evaluation approaches.
  • Communicate findings and recommendations to technical and non-technical stakeholders.

Benefits

  • Medical, dental, vision, and life insurance.
  • Generous 401(k) plan with company matching contributions and financial advisory services.
  • Tuition reimbursement up to $5,250/year.
  • Business-casual work environment with casual dress options.
  • Generous paid time off, including company holidays and floating holidays.
  • Paid volunteer time of 16 hours per year.
Full Job Description
The Data Scientist will support Empower's Responsible AI strategy by developing, applying, and validating methods used to evaluate generative AI, agentic AI, and other AI-enabled business applications.

This role focuses on fairness, explainability, transparency, hallucination, safety, reliability, and related Responsible AI measures. The Data Scientist will work with AI/ML engineers, data engineers, security engineers, architects, governance partners, and business stakeholders to ensure evaluation methods are practical, repeatable, and aligned with business and regulatory needs.

What You Will Do:

  • Apply statistical analysis and experimentation to evaluate generative AI, agentic AI, and other AI-enabled applications.
  • Develop and maintain Responsible AI measures, benchmark datasets, test suites, and evaluation criteria.
  • Evaluate AI systems for fairness, bias, explainability, transparency, hallucination, safety, reliability, and robustness.
  • Use evaluation results to support the design, testing, selection, and ongoing assessment of AI-enabled business applications.
  • Establish performance baselines and help identify changes in model or application behavior over time.
  • Design and execute proofs of concept for new Responsible AI evaluation approaches.
  • Assess emerging Responsible AI tools, frameworks, and methodologies for validity, limitations, and business applicability.
  • Support the integration of Responsible AI testing into application development, quality assurance, and governance processes.
  • Partner with engineering, architecture, quality assurance, governance, and business teams to align evaluation methods with use case requirements.
  • Create and maintain model cards, evaluation reports, methodology documentation, and related guidance.
  • Communicate findings, limitations, risks, and recommendations to technical and nontechnical stakeholders.
  • Contribute to Responsible AI training, internal education, applied research, and industry engagement.
  • Monitor emerging technologies and evaluation methods related to generative AI, agentic AI, and Responsible AI.


What You Will Bring:

  • Bachelor's degree in Data Science, Computer Science, Statistics, Mathematics, Psychology, Economics, Operations Research, or another quantitative discipline.
  • 2 to 5 years of experience in data science, statistical analysis, AI evaluation, applied research, or analytics.
  • Strong Python programming skills and experience working with data analysis and AI evaluation tools.
  • Strong SQL skills and experience working with large, complex datasets.
  • Experience designing experiments, selecting appropriate measures, and interpreting statistical results.
  • Experience evaluating generative AI applications, large language models, agentic systems, or other AI-enabled solutions.
  • Knowledge of Responsible AI concepts, including fairness, bias, explainability, transparency, hallucination, safety, reliability, and robustness.
  • Experience developing evaluation datasets, benchmarks, test cases, scorecards, or performance measures.
  • Experience translating evaluation results into recommendations for business applications and technical teams.
  • Experience with source control, automated testing, technical documentation, and basic software engineering practices.
  • Ability to assess technical methodologies, identify limitations, and communicate findings clearly.
  • Strong written and verbal communication skills.
  • Ability to work independently and collaborate across technical, governance, and business teams.


What will set you apart:

  • Advanced degree in a quantitative, behavioral science, computer science, AI, or Responsible AI-related discipline.
  • Experience evaluating large language models, generative AI applications, retrieval-augmented generation systems, or agentic AI solutions.
  • Experience with model cards, system cards, AI evaluation frameworks, or AI assurance documentation.
  • Familiarity with Responsible AI standards and frameworks, including NIST or ISO guidance.
  • Experience with fairness metrics, explainability techniques, hallucination and grounding evaluation, human evaluation, LLM-as-judge methods, or adversarial testing.
  • Experience applying Responsible AI evaluation methods within production or business-facing applications.
  • Experience in financial services or another regulated industry.
  • Experience contributing to technical publications, conferences, research collaborations, or industry working groups.


This job operates in a professional office environment.

This job description is not intended to be an exhaustive list of all duties, responsibilities and qualifications of the job. The employer has the right to revise this job description at any time. You will be evaluated in part based on your performance of the responsibilities and/or tasks listed in this job description. You may be required to perform other duties that are not included on this job description. The job description is not a contract for employment, and either you or the employer may terminate employment at any time, for any reason, as per terms and conditions of your employment contract.

What we offer you

We offer an array of diverse and inclusive benefits regardless of where you are in your career. We believe that providing our employees with the means to lead healthy balanced lives results in the best possible work performance.
  • Medical, dental, vision and life insurance
  • Retirement savings - 401(k) plan with generous company matching contributions (up to 6%), financial advisory services, potential company discretionary contribution, and a broad investment lineup
  • Tuition reimbursement up to $5,250/year
  • Business-casual environment that includes the option to wear jeans
  • Generous paid time off upon hire - including a paid time off program plus ten paid company holidays and three floating holidays each calendar year
  • Paid volunteer time - 16 hours per calendar year
  • Leave of absence programs - including paid parental leave, paid short- and long-term disability, and Family and Medical Leave (FMLA)
  • Business Resource Groups (BRGs) - BRGs facilitate inclusion and collaboration across our business internally and throughout the communities where we live, work and play. BRGs are open to all.


Base Salary Range
$87,400.00 - $123,400.00

The salary range above shows the typical minimum to maximum base salary range for this position in the location listed. Non-sales positions have the opportunity to participate in a bonus program. Sales positions are eligible for sales incentives, and in some instances a bonus plan, whereby total compensation may far exceed base salary depending on individual performance. Actual compensation offered may vary from posted hiring range based upon geographic location, work experience, education, licensure requirements and/or skill level and will be finalized at the time of offer.

About Empower

Empower is a retirement plan recordkeeping financial holding company based in Greenwood Village, Colorado, United States. It is the second-largest retirement plan provider in the United States.
Learn more about Empower

Similar Jobs

  • TeleTech
    Data Scientist
    $77K — $176K *
    TeleTech
    Chantilly, VA 20152 (Loudoun County)
  • TeleTech
    Data Scientist
    $77K — $176K *
    TeleTech
    Dayton, OH 45424 (Montgomery County)
  • New York Power Authority
    Data Scientist II
    $102K — $140K *
    New York Power Authority
    White Plains, NY 10605 (Westchester County)
  • Thomson Reuters
    Data Scientist
    $102K — $189K *
    Thomson Reuters
    Mclean, VA 22101 (Fairfax County)
  • Data Scientist
    $80K — $150K *
    Pantheon Data
    Washington, DC 20032 (District Of Columbia County)
  • FTR Production Cost Modeler
    $80K — $120K *
    Diamond Generating Corporation
    Boston, MA 02115 (Suffolk County)

More Jobs at Empower

More Information Technology Jobs

Find similar Data Scientist - Responsible AI jobs: