Software Engineer, Agent Harness

LM Studio

$120K — $145K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Significant experience in building production software for language models, developer tools, or automation.
  • Strong knowledge of tool calling, structured model output, context construction, and streaming inference.
  • Experience in developing stateful systems that can execute multi-step tasks and recover from failures.
  • Proficiency in TypeScript and solid software engineering fundamentals.
  • Passionate about open models with a practical understanding of their capabilities and limitations.
  • Demonstrated high technical intensity and accountability for the final product.

Responsibilities

  • Build and enhance the agent harness that drives Bionic.
  • Ensure local and cloud models effectively use various tools like files, Git, and document editors.
  • Integrate and optimize new open models within the Bionic agent harness.
  • Manage and maintain conversation history, working context, and recovery from interruptions.
  • Develop diagnostics to evaluate and understand agent performance and failures.
  • Smartly constrain the agent models to maximize their utility.
  • Collaborate across Bionic, LM Studio runtime, and LM Studio cloud to enhance the overall system.

Benefits

  • Competitive salary and equity grants.
  • Comprehensive medical, vision, and dental healthcare plans.
  • Catered team lunches and covered dinners at the office.
  • Flexible paid time off (PTO).
  • Remote work flexibility.
  • Bright office space in SoHo, NYC.
Full Job Description
The Role

We are looking for an Agent Harness Software Engineer to build the core agent system behind Bionic, LM Studio's agent for work and code. You will make open models effective at working with codebases, documents, files, software tools, and the user's computer.

Open models vary widely in how they reason, call tools, use context, and recover from mistakes. You will build the software that handles those differences and gets the best possible agentic performance from models running locally, on linked devices, and in LM Studio's inference cloud.

Qualifications
  • Significant experience building production software involving language models, developer tools, or automation
  • Strong understanding of tool calling, structured model output, context construction, and streaming inference
  • Experience building stateful systems that perform multi-step work and recover cleanly from failures
  • Excellent TypeScript and general software engineering fundamentals
  • Deep interest in open models and a practical understanding of their strengths and limitations
  • Works with high technical intensity and takes personal responsibility for the finished product

Responsibilities
  • Build and improve the agent harness that powers Bionic
  • Make local and cloud models reliable at using files, search, Git, the shell, web tools, and document tools
  • Integrate new open models and optimize how they perform in the Bionic agent harness
  • Manage conversation history, working context, tool results, interruptions, and recovery
  • Build repeatable evaluations and diagnostics for understanding where and why an agent fails
  • Constrain the model in a smart way so it remains useful
  • Work across Bionic, the LM Studio runtime, and LM Studio cloud to improve the complete system

Benefits
  • Competitive salary and equity grants
  • Great medical, vision, dental healthcare plans
  • Catered team lunch / expensed dinners in the office
  • Flexible PTO
  • Flexible WFH
  • Sun-drenched office in SoHo in NYC

Similar Jobs

More Jobs at LM Studio

  • GTM, Enterprise
    $135K — $160K *
    New York, NY 10025 (New York County)
    Enterprise Technology
    In-Person
  • Software Engineer, Application
    $120K — $145K *
    New York, NY 10025 (New York County)
    Information Technology
    In-Person

More Information Technology Jobs

Find similar Software Engineer, Agent Harness jobs: