AI Engineer Lead

Allstate Insurance Company

$151K — $221K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of advanced Python development experience.
  • 3+ years in AI with a focus on productizing AI/ML solutions.
  • Strong command of machine learning fundamentals for solution implementation.
  • Familiarity with GenAI technologies like RAG and vector stores.
  • Ability to make data-driven decisions combining analytical skills with business insight.
  • Excellent communication skills for technical and non-technical audiences.
  • Hands-on AI/ML experimentation and model development experience.

Responsibilities

  • Collaborate with a talented team to design and implement AI solutions.
  • Identify and explore innovative opportunities for AI technologies.
  • Develop and deploy AI/ML solutions from proof of concept to production readiness.
  • Ensure strong coding and design standards in AI engineering.
  • Engage in hands-on project work to experiment and productize solutions.
  • Work closely with product stakeholders to refine and iterate PoCs rapidly.

Benefits

  • Opportunity to work with an $80bn investment portfolio.
  • Access to a diverse and innovative team environment.
  • Autonomy to explore and prototype new AI ideas.
  • Continual learning and skill development in emerging technologies.
Full Job Description
Job Description
At Allstate Investments, we are seeking an AI Developer who is a fast learner and rapid problem solver, capable of quickly understanding new domains, technologies, and business problems, and translating them into high impact proof-of-concept (PoC) solutions. This role requires the ability to move quickly from idea to working prototypes, validate value early, and then guide successful PoCs into scalable, production-ready AI solutions.

As a member of the Investments Technology group, your work directly supports an $80bn portfolio and an organization of 300+ experts committed to excellence, innovation, and the highest ethical standards. You will be a hands-on developer - pairing daily with other engineers and guiding adoption of LLMs, RAG, vector stores, and agentic frameworks. You'll partner closely with product and platform leaders to build AI systems.

You will:

Collaborate with a highly talented and diverse team of professionals

Continuously expand your skill set by learning new technologies, tools, and methodologies.

Proactively identify opportunities for innovation, with the autonomy to rapidly explore, prototype, and validate new ideas.

Play a key role in the design, development, and deployment of AI/ML solutions.

Lead the transition of AI/ML initiatives from proof of concept to scalable, production-ready solutions.

Key Responsibilities:

  • Establish and socialize strong AI engineering fundamentals, design patterns, code quality standards.


  • Participate in projects, demonstrating technical expertise and a hands-on approach in experimentation and productization.


  • Partner with product stakeholders to iterate quickly on PoCs, incorporating feedback and refining solutions in short cycles.


Qualifications:

  • Minimum of 5 years of python development


  • Minimum of 3 years of experience working on AI projects, with a focus on productizing AI/ML solutions.


  • Deep understanding of machine leaning fundamentals and ability to apply them in developing and implementing AI/ML solutions.


  • Experience with GenAI technologies and techniques (e.g., RAG, fine-tuning, vector stores, Agentic frameworks).


  • Data-driven decision making, combining robust analytical thinking with sound business judgment.


  • Excellent communication with both technical and non-technical team members.


  • Comfort with hands-on involvement in AI/ML experimentation and model development.


  • Solid grasp of software development principles, including design patterns, testing, and version control such as Git. (preferred)


  • Inquisitive nature, with a deep understanding of both technical and business aspects. (preferred)


Technical Skills Needed:

1) Programming & Engineering Excellence

  • Python (advanced), APIs, pipelines, and AI orchestration


  • Java/ReactJS (optional)


2) LLM & GenAI Engineering

  • Hands-on experience with LLMs (preferably GPT models)


  • Prompting patterns and structured outputs


  • Model evaluation including accuracy/faithfulness checks, hallucination mitigation, regression testing


  • Safety/guardrails patterns appropriate for enterprise use


3) Demonstrated ability to leverage GitHub Copilot for code acceleration:

  • Rapid scaffolding of code, services, APIs, and development


3) Data Skills - SQL + SQL Server, Microsoft Fabric(optional)

  • SQL skills


  • Query authoring, joins, indexing awareness


  • Ability to design data access patterns for AI


4) LLM & GenAI Engineering

  • Hands-on experience with LLMs (commercial)


  • Prompting patterns and structured outputs


  • Strong experience implementing RAG architecture with ingestion pipelines, chunking strategies


  • Vector database / vector search experience with Indexing, similarity search, metadata filtering


  • Experience with MCP patterns, Standardizing tool/context access for models and agent runtimes


  • Designing MCP servers/tool endpoints and integrating them into LLM apps


  • Experience implementing agentic workflows, A2A patterns such as multi-agent collaboration (planner/executor/reviewer/retriever roles)


8) Cloud

  • MS Azure Fabric preferred


9) Observability & Production Support

  • Experience operating and supporting AI-enabled services in production:


  • Logging, metrics, tracing (APM tools such as Datadog)


  • Model/prompt monitoring, drift signals, quality regression detection


Supervisory Responsibilities
• This job does not have supervisory duties.

Education
• 4 year Bachelors Degree

#LI-PG1

Skills
Building Architecture, Emerging Technologies, Ideation, Large Language Model (LLM) Fine-Tuning, Python (Programming Language), Structured Query Language (SQL)

Compensation
Compensation offered for this role is 151,700.00 - 221,675.00 annually and is based on experience and qualifications.

Similar Jobs

More Jobs at Allstate Insurance Company

More Information Technology Jobs

Find similar AI Engineer Lead jobs: