This is a high-visibility, high-impact role suitable for experienced data scientists who also have strong communications ability and business awareness, as well as the ability to make judgment calls in ambiguous situations. You will support Global AI Model Validation and Governance’s mandate of identifying, assessing, and communicating AI/ML model risks across all AI/ML models deployed across Manulife globally. You will provide thoughtful independent challenge ot models, weighing the risks and benefits and explaining your conclusions to technical and non-technical audiences alike.
You will interact heavily with model developers, business stakeholders, and other risk management teams, each potentially offering contrasting perspectives that you will have to navigate and align simultaneously. You will also be expected to use your data science experience to mentor and guide junior members of the team.
Position Responsibilities:
- Provide independent challenge and constructive feedback for AI/ML, GenAI, and agentic models by identifying model weaknesses, limitations, assumptions, and risks, and recommending appropriate remediation actions.
- Manage competing deadlines, competing expectations, and coordinate procedural alignment to ensure the balance of risk management activities is commensurate with the business risk exposure.
- Communicate complex technical concepts and validation findings to technical and non-technical stakeholders, while ensuring that the risk management process is followed.
- Review model documentation, assess model design and performance, and communicate validation findings through clear, evidence-based reports and recommendations.
- Conduct model testing, benchmarking, sensitivity analysis, and other validation activities.
- When appropriate, evaluate whether AI models are reliable, fair, safe, explainable, and fit for their intended purpose.
- Support model inventory management, model risk operations and other AI governance processes.
- Mentor and support junior data scientists through technical coaching, knowledge sharing, and review of validation approaches and methodologies.
Required Qualifications:
- Master's degree or higher in Statistics, Biostatistics, Data Science, Engineering, Mathematics, or a related quantitative field.
- At least 3-5 years of a mix of hands-on data science experience (data science, statistics, AI/ML model development, AI/ML research, model validation, model risk management, or a related quantitative discipline) and a stakeholder-exposed role (functions that interact with varying teams and business units across the organization.)
- Strong critical thinking skills and the ability to independently challenge assumptions and assess model risk in the context of the business problem it solves.
- Hands-on keyboard report writing and code implementation; being able to implement your ideas yourself.
- Experience interpreting model performance metrics and conducting quantitative analyses in a variety of standard and non-standard contexts.
- Strong communication, written documentation, and stakeholder management skills.
- The ability to collaborate with parties from all walks of a large corporation.
Preferred Qualifications:
- Prior model validation experience for AI/ML models or development of AI/ML models for production environments with tangible risk exposures. Comparable experience includes model development in stringently risk-controlled contexts such as pharmaceuticals, aerospace, etc.
- Knowledge of AI governance and model risk regulatory expectations, with emphasis on OSFI E-23.
- Familiarity with Responsible AI concepts, including fairness, explainability, robustness, transparency, safety, and monitoring. Being passionate about Responsible AI is a plus.
- Experience evaluating Generative AI, LLMs, RAG systems, or agentic AI solutions built or customized to solve a very broad range of business problems.
- Experience developing validation frameworks, testing libraries, or automated assurance tooling.
- Experience working in a global, cross-functional environment.
- Experience performing research on AI/ML models in academic or industry settings.
When you join our team:
- We’ll empower you to learn and grow the career you want.
- We’ll recognize and support you in a flexible environment where well-being and inclusion are more than just words.
- As part of our global team, we’ll support you in shaping the future you want to see.
#LI-Hybrid
The role being advertised is an existing vacancy.
Referenced Salary Location
Toronto, Ontario
Hybrid
Salary range is expected to be between
$129,400.00 CAD - $179,400.00 CAD
Employees also have the opportunity to participate in incentive programs and earn incentive compensation tied to business and individual performance. The actual salary will vary depending on local market conditions, geography and relevant job-related factors such as knowledge, skills, qualifications, experience, and education/training. If you are applying for this role outside of the primary location, please contact for the salary range for your location.
Manulife offers eligible employees a wide array of customizable benefits, including health, dental, mental health, vision, short- and long-term disability, life and AD&D insurance coverage, adoption/surrogacy and wellness benefits, and employee/family assistance plans. We also offer eligible employees various retirement savings plans (including pension and a global share ownership plan with employer matching contributions) and financial education and counseling resources. Our generous paid time off program in Canada includes holidays, vacation, personal, and sick days, and we offer the full range of statutory leaves of absence. If you are applying for this role in the U.S., please contact for more information about U.S.-specific paid time off provisions.