ZS Associates

Lead AI Engineer

ZS Associates$120K — $160K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Master's or bachelor's degree in Computer Science or related field from a top university
  • 4+ years of hands-on experience in Machine Learning (ML) with production LLM systems
  • Solid understanding of transformer architectures and prompt engineering
  • Experience in backend API design with FastAPI and async patterns
  • Familiarity with vector databases such as Pinecone, Weaviate, or Chroma
  • Strong programming skills in Python, including asyncio and SOLID principles
  • Experience in ML Ops and model performance tracking using tools like MLFlow and Langfuse

Responsibilities

  • Design and implement LLM-powered applications using state-of-the-art transformer models
  • Build and optimize RAG pipelines with embeddings, chunking strategies, and vector search
  • Experiment with prompt engineering, structured outputs, and tool-augmented LLMs
  • Fine-tune LLMs using techniques such as LoRA and instruction tuning
  • Develop embedding models for semantic search and retrieval
  • Conduct LLM evaluations using automated and human-in-the-loop techniques
  • Optimize inference workflows for latency, GPU utilization, and cost efficiency

Benefits

  • Comprehensive total rewards package supporting health and well-being
  • Robust skills-building programs and career progression paths
  • Opportunities for internal mobility and professional development
  • Collaborative culture fostering meaningful work and capability expansion
Full Job Description
What you'll do: Lead AI Engineer in the Platforms and Products will...

We are seeking a highly motivated Applied AI Engineer with a strong foundation in Machine Learning and a deep interest in Large Language Models (LLMs) and Generative AI. This role focuses on building, optimizing, and evaluating production-grade LLM systems, including Retrieval-Augmented Generation (RAG), fine-tuning workflows, and scalable inference pipelines.
  • Design and implement LLM-powered applications using state-of-the-art transformer models.
  • Build and optimize RAG pipelines using embeddings, chunking strategies, and vector search.
  • Experiment with prompt engineering, structured outputs (JSON schemas/function calling), and tool-augmented LLMs (agents/workflows).
  • Fine-tune models using techniques such as LoRA, PEFT, and instruction tuning.
  • Develop and evaluate embedding models for similarity search and semantic retrieval.
  • Conduct LLM evaluation using automated and human-in-the-loop techniques (offline + online).
  • Optimize inference workflows for latency, GPU utilization, and cost efficiency (quantization, batching, caching).
  • Build and maintain REST API Services (FastAPI etc.) to deploy LLM/RAG endpoints, integrate with product systems, and support scalable inference.
  • Contribute to integration of AI systems into production software environments (CI/CD, monitoring, reliability).
  • Research and prototype cutting-edge approaches in Generative AI and share learnings with the team.


What you'll bring:
  • A master's or bachelor's degree in Computer Science or related field from a top university
  • 4+ years' hands-on experience in Machine Learning (ML) with production LLM systems
  • Good fundamentals of machine learning, deep learning and fine tuning models (LLM) including:
    • Understanding of transformer architectures
    • Prompt engineering expertise
    • Embeddings and vector search
  • Experienced in backend API design with FastAPI, async patterns, rate limiting
  • Experience with vector DB including:
    • Pinecone, Weaviate, or Chroma
    • Embedding storage and similarity search
    • Hybrid search implementations
  • Strong programming expertise in Python is must including:
    • Async programming (asyncio, async/await)
    • Type hints and Pydantic
    • SOLID principles and design patterns
  • Experience in ML Ops to measure and track model performance including:
    • MLFlow for model tracking
    • Langfuse for LLM observability (strongly preferred)
    • Model versioning and A/B testing
  • Experience in working with NLP & computer vision
  • Fluency in English
  • Client-first mentality
  • Intense work ethic
  • Collaborative spirit and problem-solving approach


How you'll grow:
  • Cross-functional skills development & custom learning pathways
  • Milestone training programs aligned to career progression opportunities
  • Internal mobility paths that empower growth via s-curves, individual contribution and role expansions


Perks & Benefits:

At ZS, your growth matters. We offer a comprehensive total rewards package that supports your health and well-being, financial future, time away, and professional development. With robust skills-building programs, multiple career progression paths, internal mobility, and a deeply collaborative culture, you'll have the opportunity to do meaningful work, expand your capabilities, and thrive as part of a global community. For details on total rewards in United States, visit ZS US office locations | Where we work | ZS.

Hybrid working model:

We are committed to giving our employees a flexible and connected way of working. A flexible and connected ZS allows us to combine work from home and on-site presence at clients/ZS offices for the majority of our week. The magic of ZS culture and innovation thrives in both planned and spontaneous face-to-face connections.

Travel:

Travel is a requirement at ZS for client facing ZSers; business needs of your project and client are the priority. While some projects may be local, all client-facing ZSers should be prepared to travel as needed. Travel provides opportunities to strengthen client relationships, gain diverse experiences, and enhance professional growth by working in different environments and cultures.

About ZS Associates

ZS is a professional services firm that works side by side with companies to help develop and deliver products that drive customer value and company results. From R&D to portfolio strategy, customer insights, marketing and sales strategy, operations and technology, we leverage our deep industry expertise and leading-edge analytics to create solutions that work in the real world. Our most valuable asset is our people?a fact that?s reflected in our values-driven organization in which new perspectives are integral and new ideas are celebrated. ZSers are passionately committed to helping companies and their customers thrive in industries ranging from healthcare and life sciences, to high-tech, financial services, travel and transportation, and beyond.
Learn more about ZS Associates
Size
10,000 employees
Industry
Founded
1983

Similar Jobs

More Jobs at ZS Associates

More Information Technology Jobs

Find similar Lead AI Engineer jobs: