AI Engineer, Agents and Evaluation

Pronoia Energy

$120K — $150K *
Energy & Utilities
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of experience in shipping production-grade agent systems
  • Proficient in self-hosting open-weights models on personal GPUs
  • Ability to treat hallucination and tool-misuse as engineering challenges
  • Versatile experience across orchestration, model deployment, and system evaluation
  • Self-motivated and adaptable in a fast-paced, evolving environment

Responsibilities

  • Build the core agent orchestrator and tool-routing logic for the research system
  • Deploy and maintain a self-hosted open-weights model on local hardware
  • Develop the initial verification gate and evaluation framework to ensure accuracy
  • Ensure strict routing of claims to verified sources or deterministic computations
  • Fulfill multiple roles as a founding generalist and guide future specialization

Benefits

  • Opportunity to confront significant engineering challenges in quantum energy storage
  • Equity in a transformative startup with competitive compensation
  • Access to state-of-the-art facilities and collaborative working conditions
  • Comprehensive health benefits, unlimited PTO, and professional growth opportunities
  • Innovative workplace culture focused on impactful solutions
Full Job Description
Role Summary:

To meet our ambitious goals we are building an internal, grounded, agentic AI system that accelerates our research, and we are hiring an AI Engineer to build two things: the orchestration that plans and routes the work, and the verification layer that stops the system from stating anything it cannot support. It is a founding, high-leverage role, and you will own the part of the stack that decides what counts as true before the team acts on it. In this role you will build the agent orchestrator that plans a research question into steps and routes each step to the right tool, and the first verification gate and evaluation harness that catch the system before it states anything unsupported. You will enforce our defining rule: factual questions go to retrieval, computational questions go to tools, and nothing is answered from the model's own memory. You will stand up a self-hosted open-weights model on our own hardware and build the entire agent loop around it. This is a founding generalist role, and early on you will wear several hats across orchestration, serving, and evaluation. This role is onsite in Torrance, California.

Key Responsibilities:

  • Build the agent orchestrator and the tool-routing logic at the heart of the system.
  • Stand up and serve a self-hosted open-weights model on local hardware.
  • Build the first verification gate and evaluation harness, making grounding mechanical rather than hopeful.
  • Enforce strict routing so claims trace to a retrieved source or a deterministic computation.
  • Wear several hats as a founding generalist and later hand specialties to dedicated hires.

Required Qualifications:

  • A track record shipping a real agent or tool-use system in production, not a demo.
  • Genuine experience self-hosting open-weights models on your own GPUs, not only calling a hosted API.
  • A habit of treating hallucination and tool-misuse as engineering problems with mechanical fixes.
  • Builder-generalist range across orchestration, model serving, and evaluation.
  • A self-starter who thrives amid ambiguity and rapid iteration.

Preferred Qualifications:

  • A scientific or physics background that makes our zero-fabrication standard second nature.
  • Contributions to open-source serving or agent tooling such as vLLM, TGI, or agent frameworks.
  • Experience building retrieval-augmented systems and evaluation suites.
  • Prior work in deep tech R&D alongside interdisciplinary teams.

What We Offer:

  • Chance to solve one of the world's biggest engineering challenges and pioneer quantum energy storage.
  • Competitive salary, equity in a transformative startup, and performance-based incentives.
  • Access to cutting-edge labs, tools, and resources in a flexible, collaborative work environment.
  • Comprehensive benefits: health insurance, unlimited PTO, professional development stipend, and relocation assistance if needed.
  • A culture of innovation where your work will accelerate our path to market impact.

If you're excited to tackle this real-world quantum problem and build the energy systems of the future, apply with your resume and cover letter detailing relevant projects.

Similar Jobs

More Jobs at Pronoia Energy

More Energy & Utilities Jobs

Find similar AI Engineer, Agents and Evaluation jobs: