Job DescriptionOverview Of The RoleOwn the end-to-end technical design for large-language-model (LLM) and generative-AI solutions across NVIDIA, AWS, Azure and GCP stacks. You will translate business use-cases into secure, scalable architectures, lead reference implementations, and mentor delivery teams for enterprise deployments-especially in financial-services environments.
Key Responsibilities - Shape multi-cloud architectures for training, fine-tuning and serving LLMs (e.g., NeMo, Bedrock, Azure OpenAI, Vertex AI).
- Define MLOps/GitOps patterns for model lifecycle, vector-DB indexing, retrieval-augmented generation (RAG) and guard-railing. Benchmark and cost-optimize GPU, Grace Hopper and CPU clusters (TCO & carbon impact).Build production pipelines in Python (FastAPI, LangChain, Ray, Triton, Airflow).
- Establish security and compliance controls (encryption, IAM, SOC 2, FINRA,GDPR).
- Support pre-sales and proofs-of-concept with capital-markets clients.
Skills Programming- Python (must-have)
- JavaScript / TypeScript (for web + full-stack AI apps)
- Writing clean, testable code
Math & ML Basics- Linear algebra (vectors, matrices, embeddings)
- Probability & statistics
- ML concepts: overfitting, loss functions, training vs inference
Data Skills- Data cleaning & preprocessing
- Pandas, NumPy
- SQL basics
Essential Experience- 10-15 yrs building cloud-native data or ML platforms on AWS, Azure and/or GCP. Deep expertise in Python plus one of Go, Java
- or C++.Hands-on with embedding models, tokenizer optimisation, prompt orchestration and OpenAI/Anthropic APIs. Prior delivery of enterprise Gen-AI systems (risk analytics, chatbots, document generation etc.).Solid grounding in distributed systems (K8s, service mesh, Kafka, Redis, GPU scheduling).
Preferred Qualifications- Experience with kdb+/q, ClickHouse or similar time-series stores. Contributions to open-source AI frameworks or NVIDIA NGC containers. Working knowledge of SRE/FinOps best practice.
Location & Workplace TypeThis position takes on a Hybrid working model based in Ontario, Canada.
Benefits - Competitive Salary
- Individually tailored training and skills development
- Private healthcare package and Employee Assistance Programme
- Enhanced maternity and paternity package
- Wellness Days and Volunteer Days
