Senior AI Engineer

Allstate Insurance Company

$100K — $170K *
US-AnywhereRemote in Illinois, US
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 6+ years of software engineering experience with strong proficiency in Python and GenAI.
  • Hands-on experience building LLM-based systems using commercial or open-source models.
  • Solid understanding of semantic technologies: RDF, OWL, ontologies, knowledge graphs, and SPARQL.
  • Experience with agentic AI frameworks (e.g., Google ADK, LangChain agents, or similar).
  • Strong background in data engineering concepts including ETL/ELT and star schemas.
  • Experience with cloud platforms, preferably Microsoft Azure / Microsoft Fabric.
  • Strong problem-solving skills for greenfield platform initiatives.

Responsibilities

  • Design, build, and maintain agentic AI pipelines for semantic mapping and ontology reasoning.
  • Create and evolve enterprise ontologies in RDF/OWL for reusable enterprise semantics.
  • Engineer LLM-powered services for schema understanding and AI-assisted metadata generation.
  • Implement SPARQL querying over knowledge graphs for downstream data transformation.
  • Architect and deliver Python-based microservices integrating semantic reasoning with data workflows.
  • Build and optimize dimension and fact generation pipelines on Microsoft Fabric for star schemas.
  • Define and enforce engineering standards and design patterns for AI-driven data platforms.

Benefits

  • Flexible work arrangements to promote work-life balance.
  • Opportunity for professional development and continuous learning.
  • Mentorship opportunities from senior engineers to elevate career progression.
  • Access to cutting-edge technologies in AI and data engineering.
  • Collaborative work environment with cross-functional teams.
Full Job Description
Job Description
We are seeking a Senior AI Engineer on the Enterprise Intelligence Factory team to play a foundational role in building the enterprise Semantic Ontology & Dimension Factory Platform. This platform enables AI-ready analytics by combining semantic ontologies, knowledge graphs, agentic AI, and data engineering to automatically generate business-ready star schemas from heterogeneous enterprise data sources.

In this role, you will design and implement agent-driven pipelines that leverage RDF/OWL ontologies, SPARQL, and Large Language Models (LLMs) to perform semantic alignment, dimension mining, and AI-assisted data modelling at scale. You will work at the intersection of AI, semantics, and modern data platforms, helping establish engineering patterns and best practices for the team.

This is a hands-on, senior individual-contributor role, ideal for engineers who enjoy building core platform capabilities rather than isolated experiments.

Key Responsibilities:

  • Design, build, and maintain agentic AI pipelines (using Google ADK or similar frameworks) to automate semantic mapping, dimension mining, and ontology-driven reasoning.


  • Create and evolve enterprise ontologies in RDF/OWL, including upper ontologies and domain extensions aligned to CIM (where applicable), to enable reusable enterprise semantics.


  • Engineer LLM-powered services for schema understanding, semantic alignment, ontology enrichment, and AI-assisted metadata generation, with a focus on accuracy, traceability, and scale.


  • Implement SPARQL querying and reasoning layers over knowledge graphs to drive downstream transformations and ensure consistent interpretation of business concepts.


  • Architect and deliver Python-based microservices and batch pipelines that integrate semantic reasoning with modern data-engineering workflows.


  • Build and optimize dimension and fact generation pipelines on Microsoft Fabric (Lakehouse, Spark, SQL, orchestration) to produce business-ready star schemas from heterogeneous sources.


  • Define and enforce engineering standards, design patterns, and reusable components for semantic and AI-driven data platforms (quality, observability, security, and performance).


  • Partner with data architects, domain SMEs, and governance teams to validate semantic definitions, manage change, and ensure platform scalability and adoption.


  • Conduct code reviews, mentor engineers, and influence technical decisions across the platform to raise engineering quality and delivery velocity.


Required Skills & Qualifications:
  • 6+ years of professional software engineering experience, with strong proficiency in Python and GenAI.

  • Hands-on experience building LLM-based systems using commercial or open-source models.


  • Solid understanding of semantic technologies: RDF, OWL, ontologies, knowledge graphs, and SPARQL.


  • Experience designing or working with agentic AI frameworks (e.g., Google ADK, LangChain agents, or similar).


  • Strong background in data engineering concepts (ETL/ELT, star schemas, metadata-driven pipelines).


  • Experience building and operating systems on cloud platforms, preferably Microsoft Azure / Microsoft Fabric.


  • Strong problem-solving skills and ability to work in ambiguous, greenfield platform initiatives.


Preferred Skills:

  • Experience with enterprise data models (e.g., CIM or canonical models).


  • Familiarity with semantic alignment, ontology mapping, or data cataloguing tools.


  • Exposure to MLOps / LLMOps, model evaluation, and AI observability.


  • Knowledge of distributed systems, CI/CD pipelines, and containerisation.


  • Experience building AI-assisted analytics or semantic layers for BI or NLQ use cases.


The hiring manager has flexibility to hire across several levels of seniority. The level will be determined by the selected applicant's skills and competencies.

#LI-TE1

Skills
Agentic AI, Agentic Design, AI Frameworks, Large Language Models (LLMs), LLM Guardrails, LLM Orchestration, Ontology, Python (Programming Language)

Compensation
Compensation offered for this role is 100,000.00 - 170,500.00 annually and is based on experience and qualifications.

Similar Jobs

More Jobs at Allstate Insurance Company

More Information Technology Jobs

Find similar Senior AI Engineer jobs: