Citigroup, Inc

Gen AI Engineering and Scaled AI Transformation

Citigroup, Inc • $145K — $217K *
Mississauga, ON L4T 0A1In-Person
Enterprise Technology
8 - 10 years of experience
Today
Be an Early Applicant
Job Overview by Ladders

Qualifications

  • 10+ years in software engineering, ML, or AI platforms, with 5+ years in leadership roles.
  • 3+ years of hands-on experience with LLM systems in production.
  • Expertise in commercial and open-source LLM ecosystems like OpenAI and Llama.
  • Proven ability to define enterprise-wide GenAI standards and architectures.
  • Experience in prompt engineering and orchestration standards.
  • Skills in optimizing latency, throughput, and costs for GenAI workloads.

Responsibilities

  • Act as a senior technical authority on Large Language Models.
  • Lead model selection and deployment strategies considering various constraints.
  • Architect hands-on GenAI applications and workflows using various development tools.
  • Design robust RAG architectures to enhance GenAI outputs with reliable data.
  • Establish standards for prompt engineering and optimize GenAI workflows.
  • Lead deployment of GenAI systems in secure, scalable environments.
  • Drive operational readiness and incident management for GenAI services.

Benefits

  • Hybrid work environment with flexible options.
  • Opportunities for professional development and continuing education.
  • Access to cutting-edge technology and tools for innovation.
  • Collaboration with a diverse group of professionals across the organization.
  • Strong emphasis on responsible AI practices and governance.
Full Job Description
Role Focus:Generative AI Engineering and Scaled AI Transformation for Source to Pay technology group - Hybrid

1. Large Language Model (LLM) Strategy & Technical Authority
  • Acts as a senior technical authority on Large Language Models, including both commercial and open-source ecosystems (OpenAI, Gemini, Claude, Llama).
  • Leads model selection and deployment strategy, balancing use-case fit, data sensitivity, cost efficiency, latency, accuracy, and regulatory constraints.
  • Guides decisions on hosted vs. private vs. fine-tuned models, ensuring optimal trade-offs between performance, control, and operational risk.
  • Establishes enterprise standards for LLM lifecycle management, including upgrades, regression validation, and decommissioning.

2. Hands-On GenAI Application & Agentic System Design
  • Demonstrates hands-on leadership in building GenAI applications using LangChain, LangGraph, LlamaIndex, and Hugging Face, translating experimentation into production systems.
  • Architects agentic and multi-step workflows, enabling tool-use, reasoning chains, state management, and orchestration at enterprise scale.
  • Sets reusable reference patterns and accelerators for GenAI adoption across application teams.
  • Ensures solutions are built with enterprise-grade reliability, explainability, and extensibility.

3. Retrieval Augmented Generation (RAG) & Enterprise Knowledge Enablement
  • Designs and delivers robust RAG architectures that ground GenAI outputs in trusted, auditable enterprise data.
  • Leads implementation of vector databases and embedding strategies (pgvector, Pinecone, Weaviate, FAISS), aligned with data access and security models.
  • Applies advanced retrieval techniques including hybrid search, re-ranking, metadata filtering, and context optimization to improve response accuracy and relevance.
  • Ensures RAG solutions support data lineage, auditability, and regulatory compliance.

4. Prompt Engineering, Workflow Optimization & Cost Control
  • Establishes prompt engineering and orchestration standards to ensure consistency, maintainability, and quality across GenAI solutions.
  • Optimizes GenAI workflows by actively managing latency, throughput, token cost, and accuracy trade-offs in production environments.
  • Implements evaluation and experimentation frameworks to continuously improve output quality and business value.
  • Drives disciplined use of caching, batching, fallback models, and token optimization techniques.

5. Machine Learning & Model Enablement Foundations
  • Applies strong grounding in ML/DL fundamentals, enabling informed architectural decisions and credible engagement with data science teams.
  • Leverages PyTorch and TensorFlow for embeddings, training pipelines, and targeted fine-tuning where business value is clear.
  • Ensures GenAI capabilities integrate seamlessly into the broader ML, data, and MLOps ecosystem.
  • Balances rapid GenAI delivery with long-term model sustainability and governance.

6. Production Deployment, Scalability & Operational Excellence
  • Leads deployment of GenAI systems into secure, scalable production environments using Docker, cloud-native architectures, and hardened APIs.
  • Establishes observability and monitoring for GenAI applications, covering performance, drift, quality, reliability, and failure modes.
  • Ensures GenAI platforms meet enterprise availability, resilience, and disaster recovery expectations.
  • Drives operational readiness, incident management, and ongoing optimization of AI services.

7. Software Engineering Leadership
  • Brings strong hands-on software engineering credibility, setting standards for Python-based GenAI services.
  • Leads development of high-performance AI-powered APIs using FastAPI and async programming patterns.
  • Champions clean architecture, testability, and security best practices across AI engineering teams.
  • Acts as a bridge between traditional application engineering and AI-native development.

8. AI Safety, Evaluation & Responsible AI Governance
  • Leads the implementation of AI evaluation and governance frameworks, including hallucination detection, confidence scoring, and human-in-the-loop validation.
  • Designs and enforces guardrails, moderation layers, and usage controls to prevent misuse or unintended outcomes.
  • Partners with Risk, Compliance, Legal, and Security teams to embed Responsible AI principles into all GenAI solutions.
  • Ensures GenAI adoption withstands audit, regulatory, and reputational scrutiny.

9. Leadership, Influence & Execution
  • Operates as a hands-on SVP, combining strategic influence with deep technical execution.
  • Leads senior engineers and GenAI specialists, building sustainable internal AI capability rather than point solutions.
  • Communicates complex GenAI concepts clearly to executive and non-technical stakeholders.
  • Drives delivery in agile, fast-moving environments, with a strong bias for outcomes and measurable value.


Recommended Qualifications:

  • 10+ years of progressive experience in software engineering, ML, or AI platforms, with 5+ years leading senior engineers and architects.
  • 3+ years of hands-on experience deploying LLM-based systems in production environments at enterprise scale.
  • Demonstrated authority across commercial and open-source LLM ecosystems (e.g., OpenAI, Anthropic, Google, Llama), including model selection, fine-tuning, and hosting strategies.
  • Proven ability to define enterprise-wide GenAI standards, reference architectures, and reusable accelerators.
  • Demonstrated leadership in establishing prompt engineering standards and orchestration patterns.
  • Experience optimizing latency, throughput, accuracy, and token cost across large-scale GenAI workloads.


Education:
  • Bachelor's degree/University degree or equivalent experience
  • Master's degree preferred


Job Family Group:
Technology

Job Family:
Applications Development

Time Type:
Full time

Primary Location Full Time Salary Range:
$145,100.00 - $217,700.00

Most Relevant Skills
Please see the requirements listed above.

Other Relevant Skills
For complementary skills, please see above and/or contact the recruiter.

Automated Processing and AI

We use automated processing, including artificial intelligence, for our legitimate business interests (or our reasonable and appropriate business purposes) to identify and align the candidate's skills and abilities with a specific job opening. Additionally, if you so choose, or consent, we can match your skills and abilities to other suitable roles at Citi.

Importantly, all our hiring processes and decisions, including determining your suitability for a role, are conducted, checked, and decided by individuals. Our automated processing and AI do not involve relying on automatic or autonomous decision-making. Please refer to any Jurisdictional Considerations, with specific provisions for your country (where relevant) for further details.

This job opening is for an existing job vacancy.

About Citigroup, Inc

Citigroup is a financial services holding company that provides financial products and services. The company operates through two segments, Global Consumer Banking (GCB) and Institutional Clients Group (ICG). The GCB segment offers traditional banking services to retail customers through retail banking, commercial banking, Citi-branded cards, and Citi retail services. The ICG segment offers various banking, and financial products and services to corporate, institutional, public sector, and high-net-worth clients. This segment provides wholesale banking products and services, including fixed-income and equity sales and trading, foreign exchange, prime brokerage, derivative services, equity and fixed-income research, corporate lending, investment banking, and advisory services, private banking, cash management, trade finance, and securities services. Citi is committed to sustainability and social responsibility, and the company invests in initiatives that promote economic progress.

Citigroup, Inc Careers

Join the vibrant team at Citigroup, Inc, a leading global bank, and propel your career into the future. Citigroup offers a plethora of job opportunities that span across various fields and expertise, making it an ideal place for ambitious professionals to thrive.

Work You’ll Do

At Citigroup, Inc, you will engage in exciting work that matters. Join our team to help innovate and drive transformation in the banking industry. With Citigroup, you can lead initiatives that redefine how banking works and how financial services can empower people globally.

Innovate and Lead

Citigroup, Inc is at the forefront of financial innovation and leadership. By joining our team, you will work alongside top professionals to develop solutions that enhance customer experiences and operational efficiency. Our commitment to innovation is fundamental, and we encourage our team to push boundaries and think outside the box.

Grow Your Career

Citigroup, Inc is not just a company; it's a place where you can grow both professionally and personally. We offer robust career paths and professional development opportunities that help you reach your potential. With diverse career tracks and the support of leadership, your growth at Citigroup is limitless.

Diversity and Inclusion

We believe our strength comes from the diversity of our team. Citigroup, Inc is dedicated to fostering an inclusive workplace where everyone can contribute their best work. Through diversity training and a culture that embraces differences, we create a welcoming environment for all employees.

Benefits and Culture

Citigroup, Inc values the well-being of its employees. We offer competitive benefits packages that support the health, finance, and lifestyle of our team members. Our culture is built on collaboration, respect, and a commitment to excellence. We ensure that every team member feels valued and part of our global family.

Internship and Employment Opportunities

Start your professional journey with Citigroup through our internship programs or full-time job opportunities. We are constantly hiring fresh talent and seasoned experts who bring creativity and innovation to our team. Whether you're refining your skills or ready to lead, there's a position waiting for you at Citigroup.

Networking and Professional Development

At Citigroup, Inc, networking and continuous learning are part of our DNA. We provide platforms for employees to connect with industry leaders and peers, enhancing their skills and opening up new career opportunities. Our leadership programs and professional development initiatives ensure that you are always ahead of the curve.

Join Our Team

Explore the numerous positions available at Citigroup, Inc that match your skills and interests. We are looking for passionate, curious, and solution-driven team players who are ready to make an impact.

Stay Connected

Keep up to date with the latest in career opportunities and industry insights at Citigroup, Inc. Subscribe to our job alert emails and read our careers blog to stay ahead in your professional journey.

Explore Citigroup, Inc Jobs

Discover the exciting and rewarding opportunities that await at Citigroup, Inc. Tailor your resume, prepare for your interview, and take the next step in your career with us.

SEARCH CITIGROUP JOBS

READ CAREERS BLOG

Citigroup, Inc is where your ambition meets opportunity. Join us and transform your career while making a global impact.
Learn more about Citigroup, Inc
Market Cap
$1.3 billion
Industry
Finance & Insurance
Net Income
$89.6 million
Founded
1812
5 Year Trend
+4.6%
NASDAQ
C
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at Citigroup, Inc

More Enterprise Technology Jobs

Find similar Gen AI Engineering and Scaled AI Transformation jobs:

NationwideMississauga, ON