Senior Engineering Manager, Production Engineering

Harvey

$272K — $355K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 7+ years of software or infrastructure engineering experience, with 5+ years in leadership roles.
  • Expertise in large-scale cloud infrastructure on AWS, Azure, or Google Cloud Platform.
  • Hands-on experience in operating Kubernetes in production environments.
  • Experience in building large-scale distributed systems focusing on reliability and scalability.
  • Proficient in Infrastructure-as-Code tools like Terraform or Pulumi.
  • Knowledge of observability platforms including monitoring and incident response processes.
  • Strong understanding of infrastructure security best practices.

Responsibilities

  • Lead and mentor a team of infrastructure engineers focused on production infrastructure.
  • Promote a culture of operational excellence and continuous improvement.
  • Collaborate with cross-functional teams to define infrastructure strategy and priorities.
  • Drive technical direction for compute infrastructure and production operations.
  • Manage and optimize Harvey's compute and networking infrastructure for high availability and performance.
  • Oversee capacity planning and lifecycle management of compute resources.
  • Enhance infrastructure automation with Infrastructure-as-Code practices.

Benefits

  • Opportunities for professional growth and mentorship.
  • Collaborative work culture with a focus on engineering excellence.
  • Access to cutting-edge AI and infrastructure technologies.
  • Involvement in shaping the future of a rapidly growing tech platform.
  • Dynamic and supportive team environment.
Full Job Description
Role Overview

Harvey is building the AI platform trusted by the world's leading law firms and enterprises. Our infrastructure is the foundation that powers every customer interaction, every model inference, and every production workload.

We're looking for a Senior Engineering Manager to lead our Infrastructure Foundation & Production Quality Engineering organization. This team is responsible for building and operating Harvey's core compute and networking infrastructure, Kubernetes platform, workflow orchestration platform, and production infrastructure foundations that enable engineering teams to move quickly with confidence.

In this role, you'll own the reliability, scalability, security, and efficiency of Harvey's infrastructure platform. You'll lead a team of high-performing engineers responsible for compute fleet management, capacity planning, infrastructure automation, and production operations. You'll partner closely with Product Engineering, Security, AI Infrastructure, and Platform teams to ensure our infrastructure scales with Harvey's rapid growth.

You'll report to the Head of Infrastructure and play a key leadership role in shaping the future of Harvey's infrastructure platform.

At Harvey, we value Decisiveness, Simplicity, and the belief that Job's Not Finished. We move quickly, prioritize clarity, and continuously raise the bar for engineering excellence.

What You'll Do
Leadership & Strategy
  • Lead, mentor, and grow a team of high-performing infrastructure engineers responsible for Harvey's production infrastructure foundation.
  • Foster a culture of operational excellence, engineering quality, customer ownership, and continuous improvement.
  • Partner with Engineering, Security, Product, and AI Infrastructure leaders to define long-term infrastructure strategy and execution priorities.
  • Drive technical direction for compute infrastructure, networking, Kubernetes, workflow orchestration, and production operations.
  • Lead cross-functional initiatives to improve reliability, scalability, security, operational efficiency, and infrastructure cost optimization.
Infrastructure Foundation & Production Operations
  • Own and operate Harvey's global compute and network infrastructure, ensuring high availability, scalability, reliability, and performance.
  • Manage compute resources to maximize utilization, performance, and service availability while supporting rapidly growing AI workloads.
  • Lead capacity planning, demand forecasting, and fleet lifecycle management to ensure infrastructure scales efficiently with business growth.
  • Operate and continuously improve Harvey's Kubernetes platform, including cluster provisioning, upgrades, monitoring, reliability, performance, and operational automation.
  • Own Harvey's Temporal-based workflow orchestration platform, ensuring reliable, scalable, and observable execution of distributed application workflows.
  • Drive infrastructure cost optimization through capacity management, resource rightsizing, workload efficiency improvements, and utilization monitoring.
  • Build and maintain secure infrastructure foundations, including identity and access management, network isolation, secrets management, auditing, and compliance controls.
  • Develop scalable Infrastructure-as-Code and automation frameworks using technologies such as Terraform and Pulumi.
  • Establish comprehensive observability, monitoring, alerting, incident response, and operational readiness practices across the infrastructure platform.


What You Have
  • 7+ years of software or infrastructure engineering experience, including 5+ years leading engineering teams.
  • Deep expertise operating large-scale cloud infrastructure on AWS, Azure, or Google Cloud Platform.
  • Strong hands-on experience operating Kubernetes in production, including cluster lifecycle management, networking, and reliability.
  • Experience building and operating large-scale distributed systems with strong reliability, scalability, and performance characteristics.
  • Experience with infrastructure automation and Infrastructure-as-Code using tools such as Terraform or Pulumi.
  • Strong understanding of compute infrastructure, networking, capacity planning, fleet management, and production operations.
  • Experience designing and operating observability platforms, including monitoring, logging, alerting, and incident response processes.
  • Strong understanding of infrastructure security, including IAM, network security, secrets management, and compliance best practices.
  • Demonstrated success leading complex cross-functional technical initiatives and influencing engineering strategy across organizations.
  • Excellent communication skills with the ability to communicate technical concepts clearly to both engineering and executive audiences.
  • A systems-thinking mindset and passion for building simple, reliable, and scalable infrastructure platforms.

Nice to Have
  • Experience operating workflow orchestration platforms such as Temporal.
  • Experience supporting AI/ML or LLM infrastructure at scale.
  • Experience managing GPU fleets, high-performance compute infrastructure, or large-scale capacity planning.
  • Experience with multi-cloud infrastructure or hybrid cloud environments.
Compensation

$272,000 - $355,000

Depending on your location, an Applicant Privacy Notice may apply to you. You can find all of our Applicant Privacy Notices [here].

#LI-AN2

Similar Jobs

More Jobs at Harvey

More Information Technology Jobs

Find similar Senior Engineering Manager, Production Engineering jobs: