A career as a Senior AI Scientist on the Model Risk Management team at National Bank means serving as an independent expert in the assessment of advanced artificial intelligence systems. This position allows you to have a concrete impact on the reliability, security and responsible use of the Bank's artificial intelligence solutions thanks to your expertise in AI assessment, quantitative analysis, software engineering and automation.
Your job- Design methodologies, metrics, reference data sets and acceptance criteria for evaluating AI systems
- Assess LLMs, RAG systems, agents, voice, vision and multimodal solutions based on their risk profile
- Build, maintain, and evolve agentic solutions for the purposes of model validation
- Test adversarial tests, red teaming exercises and robustness, security and confidentiality analyses
- Develop test environments, automated pipelines and reusable tools to improve validation efficiency
- Clear, rigourous and evidence-based validation conclusions to inform decision-making
- Contribute to the evolution of standards, risk management practices and requirements related to the implementation of artificial intelligence solutions.
Your team Within the Model Risk Management sector, you are part of a specialized growth team and report to the Senior Manager - AI Model Risk Management. Our team stands out for its combination of in-depth expertise in artificial intelligence, data and automation, as well as its rigour in risk management. She works closely with development teams while maintaining the independence needed to ensure effective validation of solutions.
Our goal is to offer you maximum flexibility to promote your quality of life. This includes a hybrid work environment with the possibility of working in Toronto, Montreal or Edmonton.
The Bank values continuous development and internal mobility. Our personalized training programs, based on-the-job learning, help you master your profession and develop new fields of expertise. Tools such as the Data Academy, language training, the Harvard Learning Center and coaching and mentoring support are available to you at any time.
Prerequisites - A bachelor's degree in computer science, engineering, mathematics, statistics, data science, machine learning or a related field and 2 to 5 years of relevant experience
- Experience in AI assessment, model validation, machine learning, software quality, red teaming or technology risk
- Experience designing, deploying or maintaining AI agents, LLM applications, RAG systems or AI-based automation
- Proficiency in Python, APIs, automated testing, data pipelines, version control and CI/CD practices
- Experience designing metrics, test data sets, evaluation frameworks or statistical experiments.
Languages: English, French
Reason to require this language: you will need to discuss frequently with our service providers or partners who speak a language other than French.
SkillsPress space or enter keys to toggle section visibility
Artificial Intelligence Python Risk Management Teamwork Cybersecurity Empathy Initiative Learning Agility Resiliency Large Language Model
Your benefits In addition to competitive compensation, upon hiring you'll be eligible for a wide range of flexible benefits to help promote your wellbeing and that of your family such as:
* Health and wellness program, including many options
* Flexible group insurance
* Generous pension plan
* Employee Share Ownership Plan
* Employee and family assistance program
* Preferential banking services
* Involvement in community initiatives
* Telemedicine service
* Virtual sleep clinic
We have an offer that keeps up with trends as well as your needs and those of your family.
Our dynamic work environments and cutting-edge collaboration tools foster a positive employee experience. We value employees' ideas. Whether through our surveys or programs, regular feedback and ongoing communication are encouraged.
