ServiceTitan

Senior Manager, AI Engineering (Agent OS Platform)

ServiceTitan$239K — $358K *
US-Anywhere
+ 2 other locationsRemote
Enterprise Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • MS/Ph.D. in Computer Science, Artificial Intelligence, or related field.
  • 5+ years in ML or AI engineering leadership, managing multiple teams.
  • In-depth architectural knowledge of NLP and LLMs.
  • Expertise in evaluation methodologies for non-deterministic systems.
  • Proficient in vector databases and handling unstructured data at scale.
  • Strong understanding of enterprise AI platform design and integration.
  • Excellent communication and cross-functional collaboration skills.

Responsibilities

  • Set the vision and direct the architecture of core AI infrastructure.
  • Collaborate with Product leaders to define technical roadmaps and AI capabilities.
  • Establish enterprise-wide standards and governance for AI capabilities.
  • Oversee data processing architectures and establish feedback loops for agentic systems.
  • Drive the adoption of scalable LLMOps and AgentOps frameworks.
  • Integrate advanced techniques to enhance agent capability and operational excellence.
  • Align with Engineering and Product leadership on timely and effective delivery of AI agents.

Benefits

  • Flexible time off and extensive learning opportunities.
  • Comprehensive health and wellness benefits, including medical and dental coverage.
  • Support for parental leave, fertility services, and family planning assistance.
Full Job Description
We are looking for a Senior Engineering Manager to lead a small, hands-on AI platform team building the core Agent OS. This is a builder-manager role. The right person can lead engineers, shape architecture, make high-quality technical decisions, and stay close enough to the work to unblock design, implementation, debugging, evaluation, and production delivery.

This is not a pure people-management, AI strategy, or research leadership role. We need someone who can earn credibility with senior engineers by improving the technical work, not just coordinating it. We do not expect one person to have built every part of an agent platform before. We do expect strong engineering judgment, production scars, hands-on curiosity, and the ability to learn fast while making high-quality technical decisions.

What You'll Build

You will lead a compact AI platform engineering team responsible for foundational Agent OS capabilities, including:
  • Agent runtime and workflow execution: role-specific agents, planning, tool use, delegation, pause/resume, long-running workflows, durable checkpoints, and failure recovery.
  • Context and memory systems: retrieval, tenant-aware memory, transcripts, artifacts, tool results, provenance, freshness, and replayable evidence.
  • Capability platform: reusable domain capabilities that combine prompts, tools, context requirements, policies, evals, rollout controls, ownership, and rollback expectations.
  • Action and trust layer: typed action contracts, scoped permissions, business precondition checks, approval flows, reversibility, idempotency, audit trails, and human-in-the-loop controls.
  • Evaluation and observability harness: offline and online evals, scenario libraries, simulation, trajectory review, regression detection, quality metrics, cost/latency telemetry, and autonomy promotion gates.
  • ServiceTitan integration: secure access to systems of record, governed data sources, domain context, Atlas integration, and role-specific agent experiences for owners, CSRs, dispatchers, technicians, managers, accountants, and back-office teams.


What You'll Do
  • Lead the team through architecture, implementation, production launch, and fast iteration.
  • Stay hands-on: review designs and code, inspect traces, debug production behavior, evaluate prototypes, and help engineers make pragmatic tradeoffs.
  • Translate Agent OS strategy into concrete platform slices that ship quickly without creating one-off agent implementations.
  • Define platform contracts for role shells, capabilities, tools, actions, approvals, context, memory, evidence, and evaluation.
  • Build the distinction between what an agent can do and what it is authorized to do in a given tenant, role, workflow state, and risk context.
  • Partner with Product, Design, Architecture, Security, Data Platform, Atlas, and domain engineering teams to create useful, safe, and measurable agent capabilities.
  • Drive evaluation as part of everyday engineering: scenario design, regression suites, trace review, simulation, production monitoring, quality gates, and rollout criteria.
  • Help the team make model and inference tradeoffs across latency, cost, quality, structured outputs, caching, fallback behavior, and provider choices.
  • Ensure live ServiceTitan systems of record remain authoritative while memory, retrieval, transcripts, and agent-generated artifacts are governed as contextual evidence.
  • Work through real agent failures with the team: wrong tool calls, stale context, missing permissions, unsafe actions, poor retrieval, bad recommendations, latency spikes, and cost regressions.
  • Hire, coach, and retain strong engineers who can build fast, reason deeply, and operate responsibly in a fast-moving AI environment.


What You'll Bring
  • 8+ years of software engineering experience, including 4+ years leading engineering teams or major technical initiatives in a product or platform organization.
  • Strong technical background as a builder. You may not write production code every day, but you can read code, review implementation plans, reason through distributed systems, and debug real behavior.
  • Recent hands-on technical leadership: you have personally reviewed design docs, read implementation details, inspected production traces/logs, or debugged system behavior in the last 6-12 months.
  • Experience shipping AI, ML, data, platform, infrastructure, workflow, automation, or developer-platform systems in production.
  • Practical understanding of modern LLM application architecture: model gateways, prompt/context assembly, retrieval, tool calling, structured outputs, memory, agent workflows, and human approval patterns.
  • Strong instincts for production agent safety: typed tools, scoped permissions, business invariants, precondition checks, approval thresholds, reversible actions, idempotency, audit trails, and rollback.
  • Production-minded approach to evaluation: scenario design, behavioral evals, regression suites, trace review, simulation, offline/online metrics, and monitoring for non-deterministic systems.
  • Strong engineering judgment across APIs, distributed systems, event-driven systems, data platforms, observability, reliability, security, and multi-tenant SaaS constraints.
  • Strong data and context instincts: SQL, unstructured data, vector search, metadata, provenance, source authority, freshness, and privacy boundaries.
  • Ability to turn ambiguous strategy into sequenced roadmaps, measurable outcomes, and clear ownership.
  • Clear communication with engineers, product leaders, architects, security partners, and executives.
  • Low-ego coaching style. You raise the technical bar while helping the team move faster.


Preferred Experience
  • Experience building or operating agent runtimes, workflow engines, evaluation platforms, model gateways, ML platforms, developer platforms, or internal control planes.
  • Experience with approval-gated automation, compliance-sensitive workflows, audit trails, policy engines, or governed writes to systems of record.
  • Experience integrating AI systems into complex enterprise products where permissions, tenant boundaries, data freshness, customer trust, and reliability are first-order concerns.
  • Background in SaaS, vertical software, field service, fintech, ERP, CRM, marketplace, operations, or other domains where software decisions affect real-world business outcomes.


What Success Looks Like

Success means the first Agent OS primitives are real, shipped, and usable by product teams.

Role-specific agents can be built on shared runtime, context, memory, trust, action, and evaluation foundations. Domain teams can publish governed capabilities without rebuilding infrastructure. Customers can see why an agent made a recommendation, what evidence it used, what it is allowed to do, and when a human approved it.

The best candidate will not only manage the team building this system. They will help build the system.

Remote Location: US and Canada remote candidates will be considered. Candidates based in Pacific Time or able to work significant Pacific Time overlap are highly preferred.

What We Offer:

When you join our team, you're not just accepting a job. You're making a career move. Here's how we'll support you in doing some of the most impactful work of your career:
  • Flextime, recognition, and support for autonomous work: Flexible time off with ample learning and development opportunities to continue growing your career. We offer a comprehensive onboarding program, leadership training for Titans at all levels, and other programs and events. Great work is rewarded through Bonusly, peer-nominated awards, and more.
  • Holistic health and wellness benefits: Company-paid medical, dental, and vision (with 100% employer paid options and 90% coverage for dependents), FSA and HSA, 401k match, and telehealth options including memberships to One Medical.
  • Support for Titans at all stages of life: Parental leave and support, up to $20k in fertility services (i.e. IUI and IVF), surrogacy, and adoption reimbursement, on demand maternity support through Maven Maternity, free breast milk shipping through Maven Milk, pet insurance, legal advisory services, financial planning tools, and more.

About ServiceTitan

Industry
Founded
2013

Similar Jobs

More Jobs at ServiceTitan

More Enterprise Technology Jobs

Find similar Senior Manager, AI Engineering (Agent OS Platform) jobs: