Staff Engineer, Agentic AI

Clera

$160K — $250K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 7+ years of software engineering experience, including at least 2 years with LLM-based agents.
  • Deep experience in designing LLM application architectures.
  • Proven ability to build evaluation and benchmarking frameworks for task completion.
  • Strong Python skills with familiarity in LLM tooling and APIs.
  • Experience in deploying AI or LLM tools in engineering software environments.
  • Technical leadership experience with small engineering teams.
  • Familiarity with desktop automation interfaces like COM.

Responsibilities

  • Lead development of the core agent intelligence layer for complex workflows.
  • Own the full product loop from defining capabilities to benchmarking outcomes.
  • Drive success rates by establishing evaluation frameworks and metrics.
  • Set and track token budgets to ensure commercial viability of workflows.
  • Build and maintain robust evaluation infrastructure based on user stories.
  • Conduct user story mapping and validation through direct collaboration.
  • Translate validated stories into testable evaluations for benchmarking.

Benefits

  • Equity options available in addition to salary.
  • Opportunity to work directly with the CTO.
  • Engage in a high-impact role influencing product value for enterprise clients.
  • Collaborate with a small, dedicated team of AI specialists.
  • On-site working in an innovative tech hub like San Francisco.
Full Job Description
About the Role

This Staff Engineer role sits at the core of an applied agentic AI product that automates complex, multi-step workflows across desktop engineering tools used by hardware engineers every day. Reporting directly to the CTO, you will own the agent intelligence layer end-to-end and lead a small, focused team of AI engineers, a user researcher, and domain expert contractors. The work you do here directly determines how much real-world value the product delivers to enterprise customers.
What You'll Do
  • Lead development of the core agent intelligence layer that executes multi-step workflows across complex desktop engineering software.
  • Own the full product loop: define agent capabilities from user stories, build implementations, and benchmark against real workflows.
  • Drive agent task success rate by defining evaluation frameworks, establishing baselines, and iterating on completion metrics.
  • Set and enforce per-task token budgets and track cost per completed workflow to ensure commercial viability.
  • Build rigorous, reproducible evaluation infrastructure grounded in validated user stories.
  • Lead user story mapping and validation through engineer interviews and close collaboration with domain experts.
  • Translate validated user stories into testable evals, closing the loop between user research and agent benchmarking.
  • Own agent architecture decisions including tool-calling strategies, state management, error recovery, model routing, and context management.
  • Act as a player-coach: write production code, review designs, unblock the team, and raise engineering standards.
  • Collaborate cross-functionally with integrations, product, and customers during POCs to align agent behavior with real-world usage.
What We're Looking For
  • 7+ years of software engineering experience, including at least 2 years building LLM-based agents that take real-world actions.
  • Deep experience designing LLM application architectures: model selection, context and window management, retrieval, and orchestration patterns.
  • Proven ability to build evaluation and benchmarking frameworks measuring task completion, cost efficiency, and failure modes.
  • Strong Python skills and hands-on familiarity with LLM tooling including function calling, tool APIs, observability and tracing, and evaluation frameworks.
  • Experience shipping AI or LLM tooling on top of proprietary engineering data or desktop engineering software, such as agents or MCP servers over CAD, PLM, or simulation platforms.
  • Technical leadership experience setting direction for small teams of 3 to 6 engineers while continuing to write and review production code.
  • Experience with desktop automation or programmatic control of applications such as COM or similar interfaces.
  • Domain familiarity with mechanical engineering, CAD, CAE, PLM, or adjacent engineering software industries.
  • Understanding of enterprise deployment constraints on locked-down corporate workstations.
  • Comfort operating in a fast-paced, high-intensity early-stage environment with significant customer demand.
Compensation & Benefits

Base salary range: $160,000 to $250,000 USD annually, plus equity. Visa sponsorship is not available for this role.
Location

On-site in San Francisco, California, United States.

Similar Jobs

More Jobs at Clera

  • Founding Product Engineer
    $140K — $180K *
    San Francisco, CA 94112 (San Francisco County)
    Legal & Accounting
    In-Person
  • Security Engineer
    $150K — $180K *
    San Francisco, CA 94112 (San Francisco County)
    Information Technology
    In-Person
  • Staff Engineer
    $250K — $300K *
    San Francisco, CA 94112 (San Francisco County)
    Information Technology
    In-Person
  • Staff Engineer, Agentic AI
    $160K — $250K *
    San Francisco, CA 94112 (San Francisco County)
    Information Technology
    In-Person
  • Head of Growth
    $130K — $200K *
    New York, NY 10025 (New York County)
    Healthcare
    In-Person

More Information Technology Jobs

Find similar Staff Engineer, Agentic AI jobs: