Senior Technical Program Manager, Infrastructure

Glean

$198K — $235K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • BS/MS in Computer Science, Engineering, or related technical field.
  • 8-10+ years of experience in technical program management or infrastructure.
  • 3-5 years managing infrastructure or platform-scale programs.
  • Success in cross-functional infrastructure programs in B2B or enterprise environments.
  • Strong understanding of cloud infrastructure (AWS, GCP, or Azure).
  • Experience with data pipelines and ML workflows is a plus.
  • Excellent communication skills with ability to manage ambiguity.

Responsibilities

  • Drive the Infrastructure roadmap across multiple domains.
  • Lead cross-functional programs for scalability and reliability improvements.
  • Define orchestration for deployment and monitoring of Glean instances.
  • Collaborate with AI and Data teams to enhance ML pipelines.
  • Improve observability and resource utilization initiatives.
  • Coordinate capacity planning and performance optimization.
  • Establish metrics for infra cost drivers in partnership with finance.

Benefits

  • Competitive Medical, Vision, and Dental coverage.
  • Generous time-off policy.
  • Funding for home office improvements and annual education and wellness stipends.
  • Opportunity to contribute to a 401k plan.
  • Regular company events and healthy daily lunches.
Full Job Description
About the Role:Glean is seeking a Senior Infrastructure Technical Program Manager (TPM) to lead large-scale, cross-functional initiatives that define, scale, and optimize our infrastructure platform.

This role sits at the intersection of infrastructure engineering, reliability, cost efficiency, and AI systems, driving programs that ensure Glean's platform remains performant, scalable, and resilient as we continue to grow.

You'll partner closely with Infra, AI/ML, and Platform Engineering teams to design orchestration systems, streamline deployments, and build the foundations that power our search and AI capabilities.

You'll play a central role in:

  • Driving the company's Infrastructure roadmap across Setup & Deployment, Runtime, Storage, and AI Infra.
  • Leading cross-functional programs that improve scalability, reliability, cost efficiency, and developer velocity.
  • Defining and orchestrating how Glean instances are deployed, upgraded, and monitored at scale.
  • Partnering with AI and Data teams to evolve our ML pipelines, model training infrastructure, and LLM serving stack.
  • Leading initiatives to improve observability, configuration management, and resource utilization.
  • Coordinating capacity planning, infrastructure migrations, and performance optimization programs.
  • Building clear visibility into infra cost drivers and partnering with finance and engineering leaders on optimization initiatives.


You will:

  • Lead end-to-end infra programs spanning compute, networking, storage, orchestration, and AI workloads.
  • Partner with Engineering to define standards for environment provisioning, deployment automation, and configuration governance.
  • Develop and operationalize frameworks for runtime health, scaling, and disaster recovery.
  • Drive consistency and automation across deployment orchestration systems.
  • Establish clear metrics for reliability, performance, and cost efficiency.
  • Coordinate cross-team delivery of high-impact programs such as data pipeline scalability, LLM infrastructure expansion, or infra observability improvements.
  • Communicate program status and technical risks effectively to leadership and stakeholders.
  • Continuously identify process or system bottlenecks, and drive automation to improve speed and reliability of infra operations.


About you:

  • BS/MS in Computer Science, Engineering, or a related technical field.
  • 8-10+ years of experience in technical program management, infrastructure, or SRE, with at least 3-5 years managing infra or platform-scale programs.
  • Proven success delivering cross-functional infrastructure programs in B2B or enterprise environments where scalability, uptime, and performance are critical.
  • Experience working closely with Infra, SRE, and ML/AI teams on distributed systems or data infrastructure.
  • Strong understanding of cloud infrastructure (AWS, GCP, or Azure) including compute, networking, storage, and orchestration systems.
  • Understanding of data pipelines, ML training workflows, and LLM runtime infrastructure is a plus.
  • Ability to structure complex multi-quarter infrastructure programs with clear milestones and measurable impact.
  • Strong written and verbal communication and ability to manage through ambiguity, anticipate scaling challenges, and align teams across priorities.
  • Builder mindset with focus on automation, reliability, and efficiency.


Location:

  • This role is hybrid (4 days a week in our San Francisco office)


Compensation & Benefits:

The standard base salary range for this position is $198,000 - $235,500 annually. Compensation offered will be determined by factors such as location, level, job-related knowledge, skills, and experience. Certain roles may be eligible for variable compensation, equity, and benefits.

We offer a comprehensive benefits package including competitive compensation, Medical, Vision, and Dental coverage, generous time-off policy, and the opportunity to contribute to your 401k plan to support your long-term goals. When you join, you'll receive a home office improvement stipend, as well as an annual education and wellness stipends to support your growth and wellbeing. We foster a vibrant company culture through regular events, and provide healthy lunches daily to keep you fueled and focused.

#LI-HYBRID

AI-First Mindset at Glean:

At Glean, AI fluency is core to how we work and we're committed to ensuring every new hire feels confident integrating AI into their everyday work. As part of the interview process, you'll complete a brief AI-focused exercise or discussion so we can understand how you think about, design, and use AI to drive impact in your role. Feel free to reference any tools, platforms, or workflows you use today - prior Glean experience isn't required.

Similar Jobs

More Jobs at Glean

More Information Technology Jobs

Find similar Senior Technical Program Manager, Infrastructure jobs: