Databricks

Engineering Manager, Spark Connect

Databricks$180K — $248K *
Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 10+ years in distributed systems, infrastructure, or data platforms
  • 3+ years managing high-performing engineering teams
  • Strong technical background with critical production systems
  • Experience with cross-functional initiatives and influencing technical direction
  • Passion for open source and developer platforms

Responsibilities

  • Lead the Spark Connect team to enhance Databricks Serverless
  • Own platform reliability and operational excellence
  • Drive technical leadership in open source Spark Connect
  • Define and execute OSS Spark Connect adoption strategy
  • Collaborate with various stakeholders to shape roadmap and architecture
  • Hire and develop a strong engineering team

Benefits

  • Comprehensive benefits tailored to employee needs
  • Eligibility for annual performance bonus
  • Equity options
  • Access to various employee perks
Full Job Description
The Spark Platform organization builds the core technologies that power Databricks and the Apache Spark ecosystem. Spark Connect is a critical component of Databricks Serverless and a strategic open source investment that shapes the future developer experience of Spark.

We are looking for an Engineering Manager to lead the Spark Connect team. This leader will own the Databricks Spark Connect platform, drive reliability and execution for a critical Serverless component, and lead our open source Spark Connect strategy in Apache Spark. This includes owning the OSS roadmap, partnering across teams, and driving adoption of Spark Connect in the open source ecosystem.
The impact you will have
  • Lead the team responsible for Spark Connect, a critical component of Databricks Serverless.
  • Own platform reliability, scalability, and operational excellence.
  • Drive Databricks' technical leadership in open source Spark Connect.
  • Define and execute the strategy for OSS Spark Connect adoption and ecosystem growth.
  • Partner across product, runtime, serverless, and OSS stakeholders to shape roadmap and architecture.
  • Hire and grow a strong engineering team with high technical and operational standards.
What we look for
  • 10+ years of experience in distributed systems, infrastructure, or data platforms.
  • 3+ years of experience managing high-performing engineering teams.
  • Strong technical depth and a track record of owning critical production systems.
  • Experience leading cross-functional initiatives and influencing technical direction.
  • Passion for open source, developer platforms, and large-scale systems.


Pay Range Transparency

Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page here.

Zone 2 Pay Range

$180,500-$248,150 USD

BenefitsAt Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visit https://www.mybenefitsnow.com/databricks.

About Databricks

Databricks is a unified analytics platform that provides data engineering, collaborative data science, and machine learning capabilities. The company was founded in 2013 by the original creators of Apache Spark, a popular open-source big data processing engine. Databricks provides a cloud-based platform that allows data teams to collaborate and build data pipelines, run machine learning models, and perform advanced analytics. The company has raised over $1 billion in funding and is valued at $38 billion as of November 2021.
Learn more about Databricks
Size
2,000 employees
Industry
Founded
2013

Similar Jobs

More Jobs at Databricks

More Enterprise Technology Jobs

Find similar Engineering Manager, Spark Connect jobs: