Osano

Senior AI Engineer

Osano$120K — $160K *
Enterprise Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of professional experience in AI engineering
  • Experience deploying and managing AI workloads in AWS or Azure
  • Deep understanding of LLM usage beyond prompt engineering
  • Strong expertise in Python, specifically FastAPI and LangGraph
  • Experience building complex RAG systems and autonomous AI agents
  • Proven track record in designing evaluation frameworks for AI performance

Responsibilities

  • Architect and deploy autonomous AI agents and multi-agent workflows
  • Design strict-source-following RAG systems to minimize hallucination
  • Implement guardrails and validation layers to enhance system reliability
  • Build scalable backend services using FastAPI
  • Deploy and manage AI workloads in AWS or Azure
  • Develop rigorous evaluation pipelines measuring accuracy and latency
  • Embed privacy-by-design principles across the AI stack

Benefits

  • Unlimited paid time off with a requirement to take at least two weeks off per year
  • Paid parental leave for all new parents
  • 100% premium coverage for individual medical, dental, and vision insurance
  • Fully remote work opportunity anywhere in the U.S.
  • Financial support for home workspace setup including a MacBook and $600 budget
  • Annual company trip for team building and creativity
  • Mental health benefits including free memberships for mindfulness and therapy services
Full Job Description
This role may require in-person interview/s in Austin, Texas
About the Role:

We're looking for a Senior AI Engineer to join our Engineering team. This person will play a pivotal role in architecting and delivering privacy-first AI systems that power the next generation of Osano's product capabilities.

This role goes beyond wrapping APIs or building chat interfaces. You will design and deploy autonomous AI agents, strict-source-following RAG systems, and evaluation frameworks that ensure reliability, compliance, and production-grade performance.

This position is ideal for someone who is highly technical, thrives in ambiguity, takes ownership of 01 initiatives, and believes responsible AI development is non-negotiable.
Responsibilities:
AI System Architecture
  • Architect and deploy autonomous AI agents and multi-agent workflows
  • Design strict-source-following Retrieval-Augmented Generation (RAG) systems that minimize hallucination and enforce citation integrity
  • Implement guardrails, structured outputs, and validation layers
Production Engineering
  • Build scalable backend services using FastAPI
  • Orchestrate agentic workflows using LangGraph
  • Deploy and manage AI workloads within AWS or Azure

Optimize model performance, reliability, and cost

Evaluation & Continuous Improvement
  • Develop rigorous evaluation pipelines measuring:
    • Accuracy
    • Citation adherence
    • Latency
    • Reliability
  • Establish metric-driven iteration cycles
  • Continuously refine deployed systems based on measurable outcomes
Privacy-First Development
  • Embed privacy-by-design principles across the AI stack
  • Ensure compliance, data sovereignty, and secure handling practices
  • Collaborate cross-functionally to align AI capabilities with regulatory standards
About You:
  • You're curious, self-directed, and motivated to learn quickly.
  • You're comfortable navigating ambiguity and creating clarity for others.
  • You're excited about privacy, responsible AI, and building trustworthy technology.
  • You are willing to relentlessly pursue the best, most responsible ways to leverage AI-without overselling its capabilities or ignoring its limitations.
Must-Haves:
  • 5+ years of professional experience
  • Experience deploying and managing AI workloads in AWS or Azure
  • Deep technical understanding of LLM usage and orchestration beyond prompt engineering
  • Strong expertise in Python AI ecosystem, specifically:
    • FastAPI
    • LangGraph
  • Proven experience building:
    • Complex RAG systems
    • Autonomous AI agents
  • Experience building evaluation frameworks and iterating based on performance metrics
Nice-to-Haves:
  • Experience with Knowledge Graphs to enhance RAG precision
  • Familiarity with Privacy-Enhancing Technologies (PETs)
  • Experience with data anonymization techniques
  • Background in compliance-heavy or regulated environments
Why Us:
  • We're a welcoming team that's dependable, curious, moves fast, and full of talented people
  • We're a B-corporation with a mission that matters, in a high-growth space with significant potential
  • You'll have access to our training program, well-defined career paths, and a leadership team that values professional development
Benefits:
  • Competitive-pay compensation and ownership interest/equity
  • Unlimited paid time off, plus a requirement to take at least two weeks off per year
  • We're a Best Place for Working Parents and offer paid parental leave for all new parents
  • Osano sponsors individual premiums on base plans at 100% and dependent premiums at 50% for Medical, Dental, and Vision insurance via Aetna
  • A fully and permanently remote company, so you can work from anywhere in the U.S.
  • Receive a MacBook and $600 to craft your home workspace
  • Annual company trip designed to foster connection, creativity, and fun
  • Mental health benefits with free memberships to mindfulness and talk therapy services


About Osano

Osano is a data privacy platform that helps companies comply with data privacy laws and regulations. The company provides a suite of tools that help businesses manage their data privacy policies, including consent management, data subject request management, and vendor risk management. Osano's platform is designed to be easy to use and integrate with existing systems, making it a popular choice for businesses of all sizes. The company was founded in 2018 and is headquartered in Austin, Texas.
Learn more about Osano
Size
25 employees
Industry
Founded
2018
Revenue
$1 million

Similar Jobs

More Jobs at Osano

  • Osano
    Senior AI Engineer
    $120K — $160K *
    Austin, TX 78745 (Travis County)
    Enterprise Technology
    In-Person
  • Osano
    Sales Manager
    $90K — $130K *
    Austin, TX 78745 (Travis County)
    Business Services
    In-Person
  • Osano
    Principal Product Manager
    $130K — $160K *
    Austin, TX 78745 (Travis County)
    Consumer Technology
    In-Person

More Enterprise Technology Jobs

Find similar Senior AI Engineer jobs: