Qualifications
Responsibilities
Benefits
Senior Data Analyst III
Do you like working with data and analytics to evaluate AI models and their performance?
Do you love collaborating with teams to assess and improve generative AI solutions?
About the Role
We are seeking a motivated individual to join our dynamic generative AI evaluation team. We focus on assessing and validating AI models that support healthcare decision-making tools. Our team ensures that our AI solutions meet rigorous standards for accuracy, fairness, and clinical relevance. The successful candidate will help evaluate model performance, analyze output quality, and ensure our AI solutions align with healthcare best practices.
The successful candidate has relevant experience with AI model evaluation, including performance metrics analysis, output validation, and data visualization. They enjoy collaborating with cross-functional teams including AI researchers, product managers, clinicians, and engineers to evaluate AI models, analyze their outputs, and improve their performance in healthcare contexts.
Responsibilities
Leading requirements gathering and development of analytics frameworks for evaluating generative AI models in healthcare applications
Leading and defining the strategic direction for AI evaluation methodologies in their product area
Managing the analytics roadmap for model evaluation. Collaborating with internal and external stakeholders to manage evaluation timelines and deliverables
Defining, developing, and deploying queries and metrics to assess AI model performance and output quality
Leading data model creation and maintenance for AI evaluation frameworks and monitoring systems
Conducting comprehensive QA of AI outputs and participating in risk analysis and mitigation
Understanding how security and privacy laws such as HIPAA affect AI deployment in healthcare. Understanding how to handle sensitive data including PHI and PII in AI contexts
Requirements
6-9 years of relevant experience in data analytics
Bachelor's degree required, Master's or PhD preferred in Mathematics/Science
Demonstrated thought leadership in analytics strategy and enterprise-wide project implementation
Have experience in a data analytics role
Have expertise in creating evaluation frameworks
Have expertise in using and querying relational database management systems such as Microsoft SQL Server, Snowflake or postgreSQL
Have expertise in using BI tools such as Tableau or PowerBI
Be able to demonstrate experience using Python for analysis
Work in a way that works for you
We promote a healthy work/life balance across the organisation. With an average length of service of 9 years, we are confident that we offer an appealing working prospect for our people. With numerous wellbeing initiatives, family leave and tuition reimbursement, we will help you meet your immediate responsibilities and long-term goals.
Working with us
At Elsevier, we know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:
Working for you
Join Us
Purposeful Work
When you work with us, your work matters. You are part of an organization that nurtures your curiosity to stimulate innovation for the communities that we serve.
Growing Every Day
Like the communities we serve, you are on a constant path of discovery to shape your career and personal development.
Colleagues Who Care
You will be part of the Elsevier family. We will support your well-being and provide the flexibility you need to thrive at work and home.
Together, we create possibilities.
Join us
We know your well-being and happiness are key to a long and successful career. We are delighted to offer country specific benefits. Click to access benefits specific to your location.
About Relx Group
Similar Jobs
More Jobs at Relx Group
More Healthcare Jobs
