The Data Scientist will support Empower's Responsible AI strategy by developing, applying, and validating methods used to evaluate generative AI, agentic AI, and other AI-enabled business applications.
This role focuses on fairness, explainability, transparency, hallucination, safety, reliability, and related Responsible AI measures. The Data Scientist will work with AI/ML engineers, data engineers, security engineers, architects, governance partners, and business stakeholders to ensure evaluation methods are practical, repeatable, and aligned with business and regulatory needs.
What You Will Do:- Apply statistical analysis and experimentation to evaluate generative AI, agentic AI, and other AI-enabled applications.
- Develop and maintain Responsible AI measures, benchmark datasets, test suites, and evaluation criteria.
- Evaluate AI systems for fairness, bias, explainability, transparency, hallucination, safety, reliability, and robustness.
- Use evaluation results to support the design, testing, selection, and ongoing assessment of AI-enabled business applications.
- Establish performance baselines and help identify changes in model or application behavior over time.
- Design and execute proofs of concept for new Responsible AI evaluation approaches.
- Assess emerging Responsible AI tools, frameworks, and methodologies for validity, limitations, and business applicability.
- Support the integration of Responsible AI testing into application development, quality assurance, and governance processes.
- Partner with engineering, architecture, quality assurance, governance, and business teams to align evaluation methods with use case requirements.
- Create and maintain model cards, evaluation reports, methodology documentation, and related guidance.
- Communicate findings, limitations, risks, and recommendations to technical and nontechnical stakeholders.
- Contribute to Responsible AI training, internal education, applied research, and industry engagement.
- Monitor emerging technologies and evaluation methods related to generative AI, agentic AI, and Responsible AI.
What You Will Bring:- Bachelor's degree in Data Science, Computer Science, Statistics, Mathematics, Psychology, Economics, Operations Research, or another quantitative discipline.
- 2 to 5 years of experience in data science, statistical analysis, AI evaluation, applied research, or analytics.
- Strong Python programming skills and experience working with data analysis and AI evaluation tools.
- Strong SQL skills and experience working with large, complex datasets.
- Experience designing experiments, selecting appropriate measures, and interpreting statistical results.
- Experience evaluating generative AI applications, large language models, agentic systems, or other AI-enabled solutions.
- Knowledge of Responsible AI concepts, including fairness, bias, explainability, transparency, hallucination, safety, reliability, and robustness.
- Experience developing evaluation datasets, benchmarks, test cases, scorecards, or performance measures.
- Experience translating evaluation results into recommendations for business applications and technical teams.
- Experience with source control, automated testing, technical documentation, and basic software engineering practices.
- Ability to assess technical methodologies, identify limitations, and communicate findings clearly.
- Strong written and verbal communication skills.
- Ability to work independently and collaborate across technical, governance, and business teams.
What will set you apart:- Advanced degree in a quantitative, behavioral science, computer science, AI, or Responsible AI-related discipline.
- Experience evaluating large language models, generative AI applications, retrieval-augmented generation systems, or agentic AI solutions.
- Experience with model cards, system cards, AI evaluation frameworks, or AI assurance documentation.
- Familiarity with Responsible AI standards and frameworks, including NIST or ISO guidance.
- Experience with fairness metrics, explainability techniques, hallucination and grounding evaluation, human evaluation, LLM-as-judge methods, or adversarial testing.
- Experience applying Responsible AI evaluation methods within production or business-facing applications.
- Experience in financial services or another regulated industry.
- Experience contributing to technical publications, conferences, research collaborations, or industry working groups.
This job operates in a professional office environment.
This job description is not intended to be an exhaustive list of all duties, responsibilities and qualifications of the job. The employer has the right to revise this job description at any time. You will be evaluated in part based on your performance of the responsibilities and/or tasks listed in this job description. You may be required to perform other duties that are not included on this job description. The job description is not a contract for employment, and either you or the employer may terminate employment at any time, for any reason, as per terms and conditions of your employment contract.
What we offer youWe offer an array of diverse and inclusive benefits regardless of where you are in your career. We believe that providing our employees with the means to lead healthy balanced lives results in the best possible work performance.
- Medical, dental, vision and life insurance
- Retirement savings - 401(k) plan with generous company matching contributions (up to 6%), financial advisory services, potential company discretionary contribution, and a broad investment lineup
- Tuition reimbursement up to $5,250/year
- Business-casual environment that includes the option to wear jeans
- Generous paid time off upon hire - including a paid time off program plus ten paid company holidays and three floating holidays each calendar year
- Paid volunteer time - 16 hours per calendar year
- Leave of absence programs - including paid parental leave, paid short- and long-term disability, and Family and Medical Leave (FMLA)
- Business Resource Groups (BRGs) - BRGs facilitate inclusion and collaboration across our business internally and throughout the communities where we live, work and play. BRGs are open to all.
Base Salary Range$87,400.00 - $123,400.00
The salary range above shows the typical minimum to maximum base salary range for this position in the location listed. Non-sales positions have the opportunity to participate in a bonus program. Sales positions are eligible for sales incentives, and in some instances a bonus plan, whereby total compensation may far exceed base salary depending on individual performance. Actual compensation offered may vary from posted hiring range based upon geographic location, work experience, education, licensure requirements and/or skill level and will be finalized at the time of offer.