Full stack engineer

Judgment Labs

$120K — $160K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of experience in full-stack development and scaling production systems
  • Strong problem-solving skills in dynamic environments
  • Proactive mindset with a focus on creativity and practical solutions
  • Hands-on experience with Large Language Models (LLMs) or eagerness to learn quickly
  • Experience in customer-facing roles to identify and address real-world issues
  • Strong communication abilities, both technical and non-technical

Responsibilities

  • Build product experiences that improve user interaction with agents
  • Define, develop, and iterate on complex system features independently
  • Shape and optimize the functioning of the Judgment Agent for large-scale investigations
  • Create verification platforms for agent changes and monitor their behaviors
  • Design intuitive interfaces for understanding agent decisions and debugging
  • Develop workflows to streamline the process from detecting issues to implementing fixes
  • Manage underlying platform components like workspaces, permissions, and billing

Benefits

  • On-site work in San Francisco
  • Opportunity to take ownership of projects from start to finish
  • Work in a fast-paced and innovative environment
  • Collaborate closely with customers to directly impact product development
  • Engage with cutting-edge technology in AI and agents
Full Job Description
Full-Stack Engineer

San Francisco • On Site • Full Time
The Role

Youll build the product experiences that make this loop legible, and youll build the agents that run it. This is not a role where you implement specs handed down. Youll own problems end-to-end: talking to customers, defining what to build, building it, and iterating until its great.
What You Will Accomplish
  • Judgment Agent: Shape how the Judgment Agent runs large-scale investigations: parallel investigators working across thousands of production traces, each covering a different dimension (failure modes, tool errors, regressions, drift), merging results into one answer.
  • Verification: Build the platform for verifying agent changes: hosted simulated environments for stateful agent evals, trajectory replay against changed agents, and monitors for unintended behavior changes.
  • Agent investigation interfaces: Design how engineers understand what their agents did and why. Long traces, tool calls, decisions, failures. What does debugging look like when the program is a reasoning loop? How do you make a thousand-step trajectory legible in minutes?
  • Swarm UX: A hundred parallel investigations is useless if engineers cant follow them. Design how humans watch a swarm work, redirect investigators that go down the wrong path, and consume findings without reading a hundred reports.
  • The improvement loop: Build the workflows that turn production trajectories into datasets, judges, and regression checks, so the path from found a problem to verified a fix feels like one motion.
  • The platform underneath: Workspaces, roles, permissions, billing, usage, and limits for teams running many agents across many environments.
  • Judgment everywhere agents are built: An SDK and terminal-first experience so Claude Code, Codex, and OpenCode sessions can summon Judgment as a subagent mid-development.
What Youll Bring
  • Experience building and scaling end-to-end production systems, from data layer to UI
  • Strong technical problem-solving skills, especially in fast-changing, ambiguous environments
  • A builder and tinkerers mindset with high agency - you find creative ways to overcome obstacles and ship
  • Hands-on experience building with LLMs or agents, or the drive to get there fast
  • Comfort working directly with customers to understand their needs and solve real-world problems
  • Excellent communication skills - clear, direct, and persuasive across technical and non-technical audiences

Similar Jobs

More Jobs at Judgment Labs

  • Full stack engineer
    $120K — $160K *
    San Francisco, CA 94112 (San Francisco County)
    Information Technology
    In-Person
  • Research Engineer
    $120K — $160K *
    San Francisco, CA 94112 (San Francisco County)
    Information Technology
    In-Person

More Information Technology Jobs

Find similar Full stack engineer jobs: