AI Engineer

Novella

$120K — $160K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 3+ years of software engineering experience in production systems.
  • Deep understanding of LLM application development.
  • Experience with LLM evaluation and monitoring systems.
  • Background in dataset development and benchmark creation.
  • Ability to work with TypeScript and take project ownership.

Responsibilities

  • Lead the development of autonomous agents and LLM-based applications from design to deployment.
  • Design comprehensive evaluation frameworks for LLM applications.
  • Mentor team members in LLM development and promote an AI-first culture.
  • Ensure reliable performance of LLM applications over time through rigorous testing and optimization.
  • Act as the internal AI evangelist to enhance AI tool usage across teams.

Benefits

  • Flexible working arrangements.
  • Collaborative and innovative workspace.
  • Opportunities for professional development and mentorship.
  • Engagement with cutting-edge AI technology.
Full Job Description
The Role

We're building Novella on the belief that AI should touch every part of how E&S insurance is designed, sold, and serviced. We need an AI Engineer who doesn't just build models, but builds products. You'll own the development of agentic workflows and LLM-powered systems that sit at the core of what we deliver to brokers and carriers every day.

This isn't a research role. You'll ship autonomous agents and LLM applications into production, design evaluation frameworks to make sure they actually work, and push the boundaries of what's possible with AI in an industry that barely understands technology. You'll also be our internal AI evangelist - the person who makes sure every team at Novella, technical or not, is leveraging the latest AI tools to move faster and do better work.

The Day to Day

  • Lead the development of autonomous agents and LLM-based applications, covering the entire development lifecycle from initial design through production deployment and optimization.
  • Design and develop comprehensive evaluation frameworks, including datasets and benchmarks, to ensure our LLM applications meet quality standards and perform reliably over time.
  • Provide mentorship to team members, sharing your expertise in LLM development and helping build a strong AI first technical culture

What We're Looking For

  • Proven track record as a software engineer with 3+ years of experience developing production systems.
  • Deep understanding of LLM application development, including practical experience with:
    • LLM evaluation and monitoring systems
    • AI agent architectures and frameworks
    • Retrieval-Augmented Generation (RAG)
  • Strong background in dataset development and benchmark creation for LLM applications.
  • Experience taking ownership of projects from conception to completion, with strong initiative and iterative development skills.
  • Ability/Desire to work with TypeScript

The Ideal Candidate Also Has

  • Hybrid skill set combining data driven mindset with engineering capabilities.
  • Track record of successfully deploying and maintaining ML/LLM systems in production environments.
  • Experience with performance optimization and scaling of LLM applications.
  • Experience working on AI agents.

Similar Jobs

More Information Technology Jobs

Find similar AI Engineer jobs: