AI Model Validator

The position at a glance

RISK Independent Review & Control (RISK IRC) is a special unit within the RISK organization and reports directly to the Group CRO. The independent review arm of the department provides second line of defense for the use of various types of models and, accordingly, is in charge of model risk management. RISK IRC is composed of several Model Validation groups and a Model Governance team. The Model Validation groups are responsible for performing an independent effective challenge of the modelling choices in accordance with internal policies, procedures, and standards. Further, RISK IRC is an international team with presence in 9 countries.

In detail

• Conduct independent quantitative reviews of the AI models used within BNP Paribas CUSO IHC in accordance with internal standards and regulatory guidance.
• Leverage existing expertise to validate AI models used by different groups, such as the Global Markets trading desk and the sales team.
• Identify and evaluate model risks (including performance, bias, and misuse) and recommend appropriate mitigation measures.
• Work with validation managers to develop an appropriate validation plan to provide effective challenge commensurate with the level of model risk.
• Work closely with BNPP Global Market data scientists to help BNPP be compliant with model validation requirements.
• Produce documentation of effective challenge process and materials to support committees in review and decisions.
• Assess ongoing model performance.
• Defend conclusions to management.

Minimum Required Qualifications:

• Advanced degree (Master or PhD) in Finance, Economics, Statistics, Computer Science, or any other related quantitative field.
• 3+ years of experience validating or developing AI models related to quantitative research in finance, such as derivative pricing, asset price modeling, algorithmic trading, etc.
• Solid quantitative, statistical and AI knowledge: predictive modeling, supervised/unsupervised learning, time series analysis, Natural Language Processing (NLP), and data science techniques.
• Experience in integrating Generative AI into practical use cases, including LLM-based chatbots, sentiment analyzers, and Retrieval Augmented Generation (RAG) pipelines.
• Programming experience in statistical or mathematical languages such as Python or R, and hands-on experience with version-control systems like GitHub.
• Experience with ML and NLP frameworks such as Tensorflow, PyTorch, NLTK and Gensim.
• Experience producing high quality written technical documentation.
• Strong communication and synthesis skills in addition to critical thinking capabilities and passion for learning.
• Knowledge of the English language.*

Preferred Qualifications:

In addition to the minimum requirements, it is desirable for the candidate to be able to demonstrate:

• Knowledge of the regulatory requirements (e.g. SR26-2).
• Familiarity with trading desks' products and strategies.
• Experience in developing and working on real-world machine learning projects.
• Familiarity with Frontier GenAI models (GPT, Llama, Mistral) and orchestration frameworks (LangChain and LangGraph).
• Knowledge of technical, ethical, and regulatory aspects of AI.

*Given the vast majority of our clients, both internal and external, are based outside of Quebec and Canada, specific language requirements may apply.Professional working proficiency in French and English languages are required.

While the description above describes our ideal candidate, we encourage applicants to apply even if they do not fully meet the complete list of qualifications noted

What's in it for you

Alongside a competitive compensation, we provide a comprehensive suite of flexible benefits designed to support your health, wellbeing, and long-term success:

Health & Wellness A menu of flexible options for you and your family, including a 24/7 telemedicine service.

Mental-Health Support Up to $5,000 per year for sessions with mental-health practitioners, plus unlimited access through our Employee Assistance Program.

Financial Benefits A defined-contribution pension plan and a range of additional financial perks.

Paid Volunteering Days Take time off to give back to the community.

Learning & Development Access to high-quality training, personal-development programs, and clear pathways for internal career progression across our global organization.

Work-place flexibility - Hybrid work is available for most roles. You'll be required in the office at least three days per week, with one of those days being either a Monday or a Friday.

To find out more about our range of benefits, click hre