Databricks

Senior Software Engineer - Database Engine Internals

Databricks$166K — $225K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Passion for database, storage, or distributed systems, and performance optimization
  • Experience implementing long-term projects with incremental goals
  • Strong focus on delivering value and impact to customers
  • 5+ years in relevant systems preferable
  • PhD in databases or distributed systems is a plus

Responsibilities

  • Design and implement next-gen query engines and storage systems
  • Compile and optimize queries for enhanced performance
  • Execute and schedule distributed queries effectively
  • Develop a vectorized execution engine
  • Ensure data security and manage resources efficiently
  • Coordinate transactions across systems
  • Optimize physical data structures and indexes automatically

Benefits

  • Comprehensive benefits and perks tailored to employee needs
  • Inclusive eligibility for annual performance bonuses
  • Equity options available
  • Supportive work environment promoting growth
Full Job Description
P-97 A critical part of realizing this vision is the next generation (decoupled) query engine and structured storage system that can outperform specialized data warehouses in relational query performance, yet retain the expressiveness and of general purpose systems such as Spark™ to support diverse workloads ranging from ETL to data science. As part of this team, you will be working in one or more of the following areas to design and implement these next gen systems that leapfrog state-of-the-art: • Query compilation and optimization • Distributed query execution and scheduling • Vectorized execution engine • Data security • Resource management • Transaction coordination • Efficient storage structures (encodings, indexes) • Automatic physical data optimization What we look for: • A passion for database systems, storage systems, distributed systems, language design, or performance optimization • Experience working towards a multi-year vision with incremental deliverables • Motivated by delivering customer value and impact • 5+ years of experience working in a related system (preferred) • Optional: PhD in databases or distributed systems Pay Range Transparency Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page here. Local Pay Range $166,000-$225,000 USD BenefitsAt Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region click here.

About Databricks

Databricks is a unified analytics platform that provides data engineering, collaborative data science, and machine learning capabilities. The company was founded in 2013 by the original creators of Apache Spark, a popular open-source big data processing engine. Databricks provides a cloud-based platform that allows data teams to collaborate and build data pipelines, run machine learning models, and perform advanced analytics. The company has raised over $1 billion in funding and is valued at $38 billion as of November 2021.
Learn more about Databricks
Size
2,000 employees
Industry
Founded
2013

Similar Jobs

More Jobs at Databricks

More Information Technology Jobs

Find similar Senior Software Engineer - Database Engine Internals jobs: