Senior AI Software Engineer

Allstate Insurance Company

$110K — $181K *
US-AnywhereRemote in United States
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 3+ years of backend development experience using Java Spring Boot or Python.
  • Strong understanding of RESTful APIs, microservices architecture, and asynchronous processing.
  • Experience working with Generative AI APIs and/or open-source models.
  • Familiarity with LangChain, LLM orchestration, or Retrieval-Augmented Generation (RAG) pipelines.
  • Knowledge of prompt engineering, embedding models, or vector databases.
  • Strong problem-solving and debugging skills.

Responsibilities

  • Design, develop, and maintain backend services and APIs using modern frameworks.
  • Integrate and deploy Generative AI models into production environments.
  • Fine-tune and optimize large language models (LLMs) for specific use cases.
  • Build secure, scalable, and high-performance microservices.
  • Monitor and improve system performance, reliability, and scalability.
  • Implement CI/CD pipelines, containerization, and orchestration.
  • Deploy and manage applications on cloud platforms, preferably Microsoft Azure.

Benefits

  • Comprehensive technology setup including a laptop and peripherals.
  • Monthly connectivity reimbursement for employees working from home.
Full Job Description
We are seeking a passionate and skilled Backend Developer with hands-on experience in Generative AI technologies to join our growing engineering team. This role is ideal for someone who thrives on building scalable backend systems while integrating cutting-edge AI capabilities into enterprise applications.

Job Description

Key Responsibilities:
  • Design, develop, and maintain backend services and APIs using modern frameworks (e.g., Java Spring Boot, Node.js, or Python FastAPI).
  • Integrate and deploy Generative AI models (e.g., OpenAI, Hugging Face, LangChain) into production environments.
  • Fine-tune and optimize LLMs for specific use cases.
  • Build secure, scalable, and high-performance microservices.
  • Monitor and improve system performance, reliability, and scalability.
  • Implement CI/CD pipelines, containerization (Docker), and orchestration (Kubernetes).
  • Deploy and manage applications on cloud platforms, preferably Microsoft Azure.
  • Participate in code reviews, testing, and continuous integration processes.


Required Skills & Qualifications:
  • 3+ years of backend development experience using Java Spring Boot or Python.
  • Strong understanding of RESTful APIs, microservices architecture, and asynchronous processing.
  • Experience working with Generative AI APIs and/or open-source models.
  • Experience with LangChain, LLM orchestration, or RAG (Retrieval-Augmented Generation) pipelines.
  • Familiarity with prompt engineering, embedding models, or vector databases.
  • Strong problem-solving and debugging skills.


Preferred Skills:
  • Exposure to multi-modal AI systems and agentic AI frameworks.
  • Exposure to MLOps and model deployment workflows.
  • Experience with Docker, Kubernetes, and CI/CD pipelines.
  • Experience with cloud platforms (Azure, AWS or GCP).
  • Knowledge of frontend frameworks like React or Angular.

Education
  • 4 year Bachelor's Degree

Experience
  • 3 or more years of experience

Supervisory Responsibilities
  • This job does not have supervisory duties.


Skills
Artificial Intelligence (AI), Artificial Intelligence Software, Cloud Platform, Java (Programming Language), Kubernetes, LLMOps, Pinecone (Vector Database), RAG Pipeline

Compensation
Compensation offered for this role is 110,000.00 - 181,025.00 annually and is based on experience and qualifications.

Allstate provides a comprehensive technology setup, including a laptop, monitors, headset, keyboard, and mouse. Employees eligible to work from home also receive a monthly connectivity reimbursement to help offset internet costs.

When working from home, you must have a dedicated, private workspace free from distractions, along with appropriate desk and seating. Reliable internet is required, with minimum speeds of 50 MB download and 5 MB upload.

Similar Jobs

More Jobs at Allstate Insurance Company

More Information Technology Jobs

Find similar Senior AI Software Engineer jobs: