Citigroup, Inc

Principal AI Engineer - Vice President

Citigroup, Inc$125K — $188K *
Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 10+ years of experience in software engineering, AI/ML engineering, or systems architecture.
  • Proven experience designing and deploying enterprise-grade AI systems in production.
  • Strong foundations in ML, NLP, embeddings, statistics, neural networks, and LLMs.
  • Extensive hands-on experience with LLMs like Gemini, OpenAI, Claude, Mistral, and Llama.
  • Deep expertise in RAG architectures, including retrieval optimization and semantic data modeling.

Responsibilities

  • Design and build agentic AI systems and workflows.
  • Architect fault-tolerant and scalable AI solutions using modern frameworks.
  • Define the end-to-end AI system blueprint, covering all necessary components.
  • Evaluate and select LLMs and middleware suited for enterprise requirements.
  • Partner with engineering teams to harmonize data from multiple systems.
  • Design robust data pipelines optimized for LLM workloads.
  • Develop cloud-native GenAI applications using containerized infrastructure.

Benefits

  • Comprehensive medical, dental, and vision coverage.
  • 401(k) with company match.
  • Life, accident, and disability insurance.
  • Wellness programs to support overall health.
  • Paid time off including vacation and sick leave.
Full Job Description
The Digital Software Engineering Lead Analyst is a strategic technical leader responsible for designing and engineering enterprise grade Agentic AI solutions capable of integrating data from multiple heterogeneous systems and operating reliably at scale.

You will act as a hands-on architect, engineer, and partner to cross functional teams-including Data Engineering, Architecture, Enterprise Platforms, and Product-defining the technical approach, AI system design, and integration patterns needed to build robustfault tolerantnt AI agents and AIdriven automation capabilities.

This role requires deep technical breadth across machine learning, LLMs, data pipelines, cloud engineering, orchestration, and modern AI frameworks. The solutions you design will enable strategic automation, cognitive decisioning, and dynamic multi-agent workflows across the organization.

Key Responsibilities

AI Solution Architecture & Agentic Systems
  • Design and build agentic AI systems, including autonomous agents, multiagent orchestration, tool use, and adaptive decision-making workflows.
  • Architect fault tolerant, scalable AI solutions using modern agent frameworks (e.g., Google_ADK, LangGraph, LangChain , OpenAI Assistants, CrewAI, AutoGen, custom orchestrators).
  • Define the end-to-end AI system blueprint, including knowledge integration, orchestration, pipelines, observability, governance, and failover strategies.
  • Evaluate and select LLMs, embeddings, vector stores, and middleware best suited for complex enterprise requirements.

Data Integration & Pipeline Engineering
  • Partner with engineering teams to aggregate, ingest, and harmonize data from multiple systems, including APIs, databases, internal platforms, and unstructured sources.
  • Design robust data pipelines optimized for LLM workloads (e.g., chunking, metadata design, semantic indexing, retrieval strategies).
  • Implement mechanisms for ensuring data freshness, quality, and fault tolerance across distributed systems.

LLM, RAG, and Generative AI Engineering
  • Build advanced Retrieval-Augmented Generation (RAG) architectures, including hybrid retrieval, query planning, and retrieval optimization.
  • Develop, tune, and deploy applications leveraging major LLMs (OpenAI, Gemini, Claude, Llama, Mistral, HuggingFace ecosystem).
  • Engineer prompts, system instructions, and reusable prompt templates for deterministic AI behavior.
  • Implement safety guardrails, evaluation pipelines, and bias/error mitigation strategies.

AI Platform Engineering & Deployment
  • Develop cloudnative GenAI applications using containerized infrastructure (Kubernetes, OpenShift, Docker).
  • Build and support production-grade MLOps / AIOps pipelines, including CI/CD, automated testing, monitoring, model versioning, and rollback strategies.
  • Partner with engineering teams to ensure secure, compliant deployment of all AI workloads.

Technical Leadership & Collaboration
  • Serve as technical SME for AI engineering patterns, solution design, and architecture.
  • Mentor mid-level engineers and analysts, guiding best practices in AI build patterns and engineering quality.
  • Influence product and platform strategy by providing insights on emerging GenAI and agentic technologies.


Qualification:

Experience
  • 10+ years of experience in software engineering, AI/ML engineering, systems architecture, or related fields.
  • Proven experience designing and deploying enterprisegrade AI Systems in production.


Required Technical Skills

Core AI/ML & GenAI Expertise
  • Strong foundations in ML, NLP, embeddings, statistics, neural networks, and LLMs.
  • Extensive handson experience with LLMs: Gemini, OpenAI, Claude, Mistral, Llama, opensource models, etc.
  • Deep expertise in RAG architectures, including retrieval optimization, vector search, and semantic data modeling.
  • Experience building agentic AI using Google_ADK or langGraph


Programming & Data Engineering
  • Strong proficiency in Python and libraries such as:
    Pandas, NumPy, scikitlearn, PyTorch, TensorFlow, Transformers, FastAPI, LangChain, LlamaIndex.
  • Hands-on experience with vector databases: Pinecone, PGVector, MongoDB Atlas Vector Search, Neo4j, Milvus, etc.
  • Experience building pipelines for large-scale unstructured data processing.


Cloud, DevOps, & MLOps
  • Strong CI/CD experience: GitLab CI, Jenkins, Azure DevOps, ArgoCD, GitHub Actions.
  • Expertise deploying GenAI solutions in production using:
    Kubernetes, Docker, Helm, serverless runtimes, or cloud-native LLM services.
  • Experience with monitoring, observability, and logging frameworks relevant for AI workloads.


Soft Skills
  • Exceptional problem-solving and analytical skills.
  • Ability to execute independently while operating effectively in ambiguity.
  • Strong collaboration skills across engineering, architecture, and product teams.
  • Deep commitment to ethics, transparency, and responsible AI usage.


Preferred Qualifications
  • Experience building AI systems in regulated or enterprise environments.
  • Experience using knowledge graphs, graph databases, or enterprise metadata systems.
  • Familiarity with AIOps, agent monitoring, or AI governance frameworks.


Education
  • Bachelor's degree or equivalent experience required.
  • Master's degree preferred.


Job Family Group:
Technology

Job Family:
Digital Software Engineering

Time Type:
Full time

Primary Location:
Tampa Florida United States

Primary Location Full Time Salary Range:
$125,600.00 - $188,400.00

In addition to salary, Citi's offerings may also include, for eligible employees, discretionary and formulaic incentive and retention awards. Citi offers competitive employee benefits, including: medical, dental & vision coverage; 401(k); life, accident, and disability insurance; and wellness programs. Citi also offers paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays. For additional information regarding Citi employee benefits, please visit citibenefits.com. Available offerings may vary by jurisdiction, job level, and date of hire.

Most Relevant Skills
Please see the requirements listed above.

Other Relevant Skills
For complementary skills, please see above and/or contact the recruiter.

Anticipated Posting Close Date:
Jun 25, 2026

About Citigroup, Inc

Citigroup is a financial services holding company that provides financial products and services. The company operates through two segments, Global Consumer Banking (GCB) and Institutional Clients Group (ICG). The GCB segment offers traditional banking services to retail customers through retail banking, commercial banking, Citi-branded cards, and Citi retail services. The ICG segment offers various banking, and financial products and services to corporate, institutional, public sector, and high-net-worth clients. This segment provides wholesale banking products and services, including fixed-income and equity sales and trading, foreign exchange, prime brokerage, derivative services, equity and fixed-income research, corporate lending, investment banking, and advisory services, private banking, cash management, trade finance, and securities services. Citi is committed to sustainability and social responsibility, and the company invests in initiatives that promote economic progress.

Citigroup, Inc Careers

Join the vibrant team at Citigroup, Inc, a leading global bank, and propel your career into the future. Citigroup offers a plethora of job opportunities that span across various fields and expertise, making it an ideal place for ambitious professionals to thrive.

Work You’ll Do

At Citigroup, Inc, you will engage in exciting work that matters. Join our team to help innovate and drive transformation in the banking industry. With Citigroup, you can lead initiatives that redefine how banking works and how financial services can empower people globally.

Innovate and Lead

Citigroup, Inc is at the forefront of financial innovation and leadership. By joining our team, you will work alongside top professionals to develop solutions that enhance customer experiences and operational efficiency. Our commitment to innovation is fundamental, and we encourage our team to push boundaries and think outside the box.

Grow Your Career

Citigroup, Inc is not just a company; it's a place where you can grow both professionally and personally. We offer robust career paths and professional development opportunities that help you reach your potential. With diverse career tracks and the support of leadership, your growth at Citigroup is limitless.

Diversity and Inclusion

We believe our strength comes from the diversity of our team. Citigroup, Inc is dedicated to fostering an inclusive workplace where everyone can contribute their best work. Through diversity training and a culture that embraces differences, we create a welcoming environment for all employees.

Benefits and Culture

Citigroup, Inc values the well-being of its employees. We offer competitive benefits packages that support the health, finance, and lifestyle of our team members. Our culture is built on collaboration, respect, and a commitment to excellence. We ensure that every team member feels valued and part of our global family.

Internship and Employment Opportunities

Start your professional journey with Citigroup through our internship programs or full-time job opportunities. We are constantly hiring fresh talent and seasoned experts who bring creativity and innovation to our team. Whether you're refining your skills or ready to lead, there's a position waiting for you at Citigroup.

Networking and Professional Development

At Citigroup, Inc, networking and continuous learning are part of our DNA. We provide platforms for employees to connect with industry leaders and peers, enhancing their skills and opening up new career opportunities. Our leadership programs and professional development initiatives ensure that you are always ahead of the curve.

Join Our Team

Explore the numerous positions available at Citigroup, Inc that match your skills and interests. We are looking for passionate, curious, and solution-driven team players who are ready to make an impact.

Stay Connected

Keep up to date with the latest in career opportunities and industry insights at Citigroup, Inc. Subscribe to our job alert emails and read our careers blog to stay ahead in your professional journey.

Explore Citigroup, Inc Jobs

Discover the exciting and rewarding opportunities that await at Citigroup, Inc. Tailor your resume, prepare for your interview, and take the next step in your career with us.

SEARCH CITIGROUP JOBS

READ CAREERS BLOG

Citigroup, Inc is where your ambition meets opportunity. Join us and transform your career while making a global impact.
Learn more about Citigroup, Inc
Market Cap
$1.3 billion
Industry
Net Income
$89.6 million
Founded
1812
5 Year Trend
+4.6%
NASDAQ

Similar Jobs

More Jobs at Citigroup, Inc

More Enterprise Technology Jobs

Find similar Principal AI Engineer - Vice President jobs: