Databricks

Senior Software Engineer - Database Engine Internals

Databricks$166K — $225K *
Enterprise Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience in database or distributed systems
  • Passion for database and storage systems
  • Experience with multi-year vision projects
  • Motivated to deliver customer value
  • Optional: PhD in related field

Responsibilities

  • Design and implement next-generation query systems
  • Develop query compilation and optimization techniques
  • Lead distributed query execution and scheduling
  • Build a vectorized execution engine
  • Enhance data security measures
  • Manage resource allocation effectively
  • Coordinate transactions for system stability
  • Create efficient storage structures and optimizations

Benefits

  • Comprehensive health insurance
  • Retirement plan options
  • Annual performance bonuses
  • Equity opportunities
  • Flexible work environment
Full Job Description
A critical part of realizing this vision is the next generation (decoupled) query engine and structured storage system that can outperform specialized data warehouses in relational query performance, yet retain the expressiveness and of general purpose systems such as Apache Spark™ to support diverse workloads ranging from ETL to data science.

As part of this team, you will be working in one or more of the following areas to design and implement these next gen systems that leapfrog state-of-the-art:
  • Query compilation and optimization
  • Distributed query execution and scheduling
  • Vectorized execution engine
  • Data security
  • Resource management
  • Transaction coordination
  • Efficient storage structures (encodings, indexes)
  • Automatic physical data optimization

What we look for:
  • A passion for database systems, storage systems, distributed systems, language design, or performance optimization
  • Experience working towards a multi-year vision with incremental deliverables
  • Motivated by delivering customer value and impact
  • 5+ years of experience working in a related system (preferred)
  • Optional: PhD in databases or distributed systems


Pay Range Transparency

Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page here.

Local Pay Range

$166,000-$225,000 USD

BenefitsAt Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region click here.

About Databricks

Databricks is a unified analytics platform that provides data engineering, collaborative data science, and machine learning capabilities. The company was founded in 2013 by the original creators of Apache Spark, a popular open-source big data processing engine. Databricks provides a cloud-based platform that allows data teams to collaborate and build data pipelines, run machine learning models, and perform advanced analytics. The company has raised over $1 billion in funding and is valued at $38 billion as of November 2021.
Learn more about Databricks
Size
2,000 employees
Industry
Founded
2013

Similar Jobs

More Jobs at Databricks

More Enterprise Technology Jobs

Find similar Senior Software Engineer - Database Engine Internals jobs: