Software Engineer, Applied AI

Shepherd

• $140K — $170K *
Finance & Insurance
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of backend engineering experience with scalable APIs
  • Experience launching AI-powered products to production
  • Knowledge of LLMs, RAG architectures, and vector databases
  • Skill in integrating AI solutions into workflow applications
  • Familiarity with cloud infrastructure and managing AI deployments
  • Ability to transform abstract business challenges into concrete technical solutions

Responsibilities

  • Collaborate with cross-functional teams to pinpoint AI opportunities
  • Design and implement features utilizing LLM technology for underwriting and pricing
  • Create AI systems to derive insights from unstructured data
  • Develop and manage AI infrastructure for efficient model operations
  • Build internal tools that enhance underwriting and operational efficiency
  • Set standards for prompt engineering and model reliability
  • Oversee AI projects from initial concept to deployment

Benefits

  • 100% coverage for top-tier health, dental, and vision insurance
  • Flexible unlimited PTO policy for better work-life balance
  • Daily meals, including lunches and dinners, provided
  • Work from chic offices in SF, NYC, or Dallas-Fort Worth
  • Opportunities for professional development with premium coaching
  • Access to a competitive 401(k) plan
  • Pet-friendly office environment with dogs around
Full Job Description
The Role

We are hiring a Software Engineer focused on Applied AI to build intelligent systems that directly power our underwriting and pricing engine. This role sits at the intersection of product engineering, AI infrastructure, and real-world insurance workflows.

You will design and ship production AI systems that meaningfully improve how we evaluate risk, price policies, and operate our business.

What You'll Do
  • Partner with product, engineering, underwriting, and data teams to identify high-leverage AI opportunities
  • Design, build, and deploy LLM-powered features across underwriting, pricing, and internal tooling
  • Develop AI agents and retrieval-augmented systems that extract structured insights from unstructured insurance data
  • Build production-grade AI infrastructure for model serving, inference, evaluation, and monitoring
  • Create internal AI tools that enable underwriters and operators to move faster with higher quality decisions
  • Establish best practices for prompt engineering, evaluation frameworks, and model reliability
  • Own AI features end-to-end from ideation to production


What We're Looking For
  • Strong backend engineering experience building scalable APIs and distributed systems
  • Hands-on experience shipping AI-powered products into production
  • Familiarity with LLMs, RAG architectures, embeddings, and vector databases
  • Experience integrating AI systems into user-facing or workflow-driven applications
  • Comfort with cloud infrastructure and deploying AI workloads at scale
  • A product mindset and the ability to translate ambiguous business problems into concrete AI systems
  • You have at least 5+ years of working experience (preferably as a full-stack engineer) with a track record of delivering high-impact products


Bonus Points
  • Experience building AI agents or multi-step reasoning systems
  • Background in applied machine learning beyond generative AI
  • Experience with pricing systems, financial infrastructure, or risk modeling
  • Interest in transforming legacy industries with modern AI systems


Why This Role Matters

Insurance is one of the largest industries in the world, yet much of underwriting and pricing remains manual and fragmented. At Shepherd, AI is not a side project - it is core to how we build durable competitive advantage.

You will help define how applied AI transforms risk evaluation in high-hazard industries and shape the future of AI-native insurance infrastructure.

Our Tech Stack

Frontend
  • React & Next.js
  • Typescript
  • GraphQL w/ Apollo

Backend
  • Node.js
  • Postgres & Redis
  • Typescript
  • GraphQL APIs


How we work

Shepherd runs on four values. Here's what each one means in this seat.
  • Think big, build big. We exist to protect progress and the industries that rely on it. The work here is aimed at a system that runs on its own, and the roadmap gets sequenced backward from that rather than forward from what's easy.
  • Win together. We rise as one. We support each other, raise the bar, and celebrate collective success. As the first PM you set a standard the rest of the team inherits, and the milestones belong to the team rather than to product.
  • Cross the aisle. Collaboration wins. We listen deeply, work across boundaries, and prioritize shared success over individual lanes. The best product calls here come from engineers who've sat with underwriters and underwriters who understand where the model breaks, and much of this job is listening closely enough on both sides to make that happen.
  • Go get it. We act with urgency, move with confidence, take smart risks, and push forward with intention. Nobody hands you the roadmap, the data, or the meeting invite. You pull the failing runs, book the time with the underwriters, and decide what matters.


Benefits

Premium Healthcare
100% contribution to top-tier health, dental, and vision

🥕 Fertility benefits and family building support

Unlimited PTO
Flexibility to take the time off, recharge, and perform

🥗 Daily lunches, dinners, and snacks
We work together, and enjoy meals together too

SF, NYC, Dallas-Fort Worth, Chicago and LA Offices

Professional Development
Access to premium coaching, including leadership development

Competitive401(k) Plan

Dog-friendly office
Plenty of dogs to play with and make friends with in the SF office

Similar Jobs

More Jobs at Shepherd

  • Software Engineer, Applied AI
    $140K — $170K *
    San Francisco, CA 94112 (San Francisco County)
    Finance & Insurance
    In-Person
  • Software Engineer, Full Stack
    $130K — $155K *
    San Francisco, CA 94112 (San Francisco County)
    Information Technology
    In-Person
  • Actuarial Data Analyst
    $110K — $140K *
    New York, NY 10025 (New York County)
    Finance & Insurance
    In-Person
  • Actuarial Data Analyst
    $110K — $140K *
    Chicago, IL 60629 (Cook County)
    Finance & Insurance
    In-Person
  • Actuarial Data Analyst
    $110K — $140K *
    San Francisco, CA 94112 (San Francisco County)
    Finance & Insurance
    In-Person

More Finance & Insurance Jobs

Find similar Software Engineer, Applied AI jobs: