Staff AI Engineer - Zoom AI Services Platform

Zoom Video Communications, Inc.

$177K — $387K *
Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor’s or Master’s in Computer Science, Electrical Engineering, or related field, or equivalent experience.
  • 8+ years in software engineering with a focus on distributed systems and cloud platforms.
  • Proven experience in production AI services (e.g., Speech Recognition, Machine Translation).
  • Strong skills in designing cloud services with microservices and multi-tenant architectures.
  • Experience in designing APIs, SDKs, or cloud services with an API-first approach.
  • In-depth knowledge of Kubernetes, distributed systems, and cloud-native technologies.
  • Proficient in programming languages such as Go, Java, C++, or Python.

Responsibilities

  • Design and build scalable cloud services for Zoom AI APIs and developer platform.
  • Create reusable APIs and service abstractions for AI functionalities.
  • Construct distributed systems for various AI workloads including synchronous and asynchronous tasks.
  • Enhance scalability and reliability of AI services through monitoring and optimization.
  • Implement scheduling and resource management for CPU and GPU infrastructures.
  • Collaborate with AI modeling and product teams to integrate new capabilities into the platform.
  • Lead technical architecture and promote best engineering practices within the team.

Benefits

  • Comprehensive benefits program focused on employees' physical, mental, emotional, and financial well-being.
  • Support for work-life balance with flexible work arrangements.
  • Opportunities to contribute to community initiatives and projects.
Full Job Description

What You Can Expect

You’ll design, build, and own the platform that powers Zoom AI Services, enabling AI capabilities to be delivered as scalable cloud services for both Zoom products and external developers. You’ll work across API design, distributed systems, cloud infrastructure, and AI platform engineering to build reliable, high-performance services that power speech, translation, summarization, reasoning, and future AI capabilities at production scale.

Responsibilities

  • Design and build large-scale cloud services powering Zoom AI APIs and developer platform.

  • Design reusable APIs, service abstractions, and platform components for AI capabilities.

  • Build distributed systems supporting synchronous, asynchronous, and streaming AI workloads.

  • Improve scalability, reliability, observability, and operational efficiency of AI services.

  • Design scheduling, resource management, and workload orchestration for large-scale CPU and GPU infrastructure.

  • Partner closely with AI modeling, platform, and product teams to onboard new AI capabilities onto the Zoom AI Services platform.

  • Drive technical architecture and engineering best practices across the team.

What We’re Looking For

  • Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related technical field, or equivalent practical experience.

  • 8+ years of software engineering experience building distributed systems, cloud platforms, or large-scale backend services.

  • Experience building and operating production AI services such as Speech Recognition (ASR), Machine Translation (MT), LLM applications, AI Agents, Search, Document Intelligence, Computer Vision, or similar AI-powered cloud services.

  • Strong experience designing and operating large-scale cloud services, including microservices, service-oriented architectures, and multi-tenant platforms.

  • Experience designing developer-facing APIs, SDKs, or cloud platform services with a strong API-first mindset.

  • Strong understanding of Kubernetes, containers, distributed systems, networking, and cloud-native technologies.

  • Experience building highly available, scalable, and observable production systems running at cloud scale.

  • Experience working with AI infrastructure, including model serving, AI inference platforms, GPU/CPU resource management, or ML infrastructure.

  • Strong programming skills in Go, Java, C++, Python, or similar languages.

  • Excellent system design, technical leadership, and cross-functional collaboration skills, with the ability to drive architecture across multiple engineering teams.

Preferred

  • Experience with one or more major cloud platforms (AWS, Azure, or GCP).

  • Experience optimizing large-scale AI workloads for performance, scalability, reliability, or cost.

  • Experience contributing to AI platforms serving both internal products and external developers.

  • Experience with open-source AI infrastructure such as Kubernetes, Istio, vLLM, Triton, SGLang, Ray, or similar technologies.


 

Salary Range or On Target Earnings:

Minimum:

$177,100.00

Maximum:

$387,500.00

In addition to the base salary and/or OTE listed Zoom has a Total Direct Compensation philosophy that takes into consideration; base salary, bonus and equity value.

Note: Starting pay will be based on a number of factors and commensurate with qualifications & experience.

We also have a location based compensation structure;  there may be a different range for candidates in this and other locations.

Ways of Working
Our structured hybrid approach is centered around our offices and remote work environments. The work style of each role, Hybrid, Remote, or In-Person is indicated in the job description/posting.

Benefits
As part of our award-winning workplace culture and commitment to delivering happiness, our benefits program offers a variety of perks, benefits, and options to help employees maintain their physical, mental, emotional, and financial health; support work-life balance; and contribute to their community in meaningful ways. Click Learn for more information.

Similar Jobs

More Jobs at Zoom Video Communications, Inc.

More Enterprise Technology Jobs

Find similar Staff AI Engineer - Zoom AI Services Platform jobs: