Databricks

Sr. Engineering Manager, AI Runtime

Databricks$228K — $297K *
Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 8+ years of software engineering experience, including 3+ years in engineering management.
  • Proven experience in building and managing large-scale GPU training infrastructure.
  • Familiarity with distributed training frameworks such as PyTorch and DeepSpeed.
  • Experience with training resilience strategies like checkpointing and automated failure recovery.
  • Strong understanding of GPU performance fundamentals and optimization techniques.
  • Track record of delivering platform products with end-user experience focus.
  • Excellent leadership and collaborative skills in cross-functional environments.

Responsibilities

  • Lead and mentor a high-performing engineering team for AIR's Custom Training product.
  • Define the product and technical roadmap balancing user experience and foundational investments.
  • Collaborate with various teams for end-to-end delivery from ideation to launch.
  • Drive architectural decisions for scalable managed GPU training solutions.
  • Advocate for customer needs to ensure impactful engineering decisions.
  • Establish observability and reliability practices for multi-node training jobs.
  • Partner with recruiting to attract and develop top-tier engineering talent.

Benefits

  • Comprehensive benefits package to support employees' needs.
  • Eligibility for annual performance bonus and equity options.
Full Job Description
Databricks' AI Runtime (AIR) product provides enterprises with an API for training and fine-tuning deep learning and LLM models with on-demand GPUs. Whether it's a transformer model for drug discovery or a fine-tuned foundation model, customers use this team's training infrastructure to build state-of-the-art frontier models. As a Senior Engineering Manager, you will lead the team owning both the product experience and the foundational infrastructure of AIR. You'll shape customer-facing capabilities while designing for scalability, extensibility, and performance of GPU training and adjacent areas, collaborating closely across the platform, product, infrastructure, and research organizations. The impact you will have: • Lead, mentor, and grow a high-performing engineering team responsible for the Custom Training product and its foundational infrastructure, including distributed training orchestration, cluster lifecycle, fault tolerance, and training efficiency. • Define and own the product and technical roadmap for AIR, balancing customer experience, functionality, and foundational investments. • Collaborate closely with product, research, platform, infrastructure teams, and customers to drive end-to-end delivery, from ideation and prioritization to launch and operation. • Drive architectural decisions and product design for managed GPU training at scale. • Advocate for customer needs through direct engagement, ensuring engineering decisions translate to clear product impact. • Build observability and reliability practices for long-running, multi-node training jobs, including checkpoint strategies, failure recovery, and operational runbooks. • Partner with recruiting to attract, hire, and develop top-tier engineering talent. What we look for: • 8+ years of software engineering experience, with 3+ years in engineering management. • Track record building and operating managed GPU training infrastructure at scale (100s/1000s GPUs). • Deep familiarity with distributed training frameworks (PyTorch, DeepSpeed, Composer, Megatron-LM) and parallelism strategies (FSDP, tensor/pipeline parallelism). • Experience with training resilience patterns: checkpointing, elastic training, and automated failure recovery for long-running jobs. • Understanding of GPU performance fundamentals including NCCL, interconnect topologies, and memory optimization. • Experience building platform products with clear SLAs where you've owned the customer experience, not just the backend. • Strong cross-functional leadership across platform, product, and research teams, with the ability to lead through ambiguity and deliver complex projects. • Excellent collaboration and communication skills across engineering, product, and research organizations. • BS/MS in Computer Science, Electrical Engineering, or related technical field. Pay Range Transparency Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page here. Local Pay Range $228,600-$297,120 USD BenefitsAt Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region click here.

About Databricks

Databricks is a unified analytics platform that provides data engineering, collaborative data science, and machine learning capabilities. The company was founded in 2013 by the original creators of Apache Spark, a popular open-source big data processing engine. Databricks provides a cloud-based platform that allows data teams to collaborate and build data pipelines, run machine learning models, and perform advanced analytics. The company has raised over $1 billion in funding and is valued at $38 billion as of November 2021.
Learn more about Databricks
Size
2,000 employees
Industry
Founded
2013

Similar Jobs

More Jobs at Databricks

More Enterprise Technology Jobs

Find similar Sr. Engineering Manager, AI Runtime jobs: