Databricks

Staff Software Engineer, AI Search

Databricks$166K — $225K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 10+ years of experience with large-scale distributed systems.
  • Expertise in search technologies (vector, keyword, hybrid).
  • Knowledge of indexing, ranking, and retrieval infrastructure.
  • Familiarity with storage systems and recommendation engines.
  • Strong understanding of algorithms and data structures related to retrieval.
  • Experience leading architecture for performance-sensitive systems.
  • Excellent communication skills for collaboration in fast-paced environments.
  • Strategic mindset aligning technical and product visions.

Responsibilities

  • Drive architecture and evolution of the Search product for low-latency retrieval.
  • Solve indexing, storage, query execution, and ranking challenges.
  • Collaborate with infrastructure and product teams to shape APIs for AI applications.
  • Lead engineering efforts from design to deployment ensuring high performance standards.
  • Contribute directly to core systems powering search and recommendation features.
  • Mentor engineers and promote software engineering best practices.
  • Influence long-term planning for search and AI infrastructure.

Benefits

  • Comprehensive benefits and perks to meet employee needs.
Full Job Description
RDQ427R351

As a Staff Engineer for Search, you'll play a critical role in building and scaling our next-generation Search product - spanning Vector Search, Keyword Search, and Search Quality. You'll drive the design and evolution of a highly-performant, cost-efficient, and developer-friendly Search stack that enables customers to build AI applications with accuracy, speed, and scale. Beyond hands-on contributions, you'll help define the long-term vision, mentor senior engineers, collaborate across teams, and lead strategic efforts that expand the technical and business impact of Search at Databricks.

The impact you will have:
  • Drive the architecture and evolution of the Search product, delivering scalable, low-latency, and high-quality retrieval across massive multimodal datasets.
  • Identify and solve challenges in indexing, storage, query execution, and ranking - blending innovations in vector search, keyword search, and hybrid retrieval techniques.
  • Partner with infrastructure, product, and research teams to shape APIs and developer experiences that make it easy to build production-grade, AI-powered and search-driven applications.
  • Lead end-to-end engineering efforts - from design to production rollout - ensuring high standards for performance, correctness, and reliability.
  • Make direct, high-impact contributions to core systems powering search, discovery, and recommendation experiences.
  • Champion software engineering excellence and mentor other engineers through design reviews, technical discussions, and collaborative development.
  • Contribute to long-term planning and influence Databricks' technical direction in search, AI infrastructure, and data systems.

What we look for:
  • 10+ years of experience building and operating large-scale distributed systems.
  • Deep expertise in Search technologies (vector, keyword, hybrid) and related domains such as indexing, ranking, retrieval infrastructure, and relevance optimization.
  • Familiarity with storage systems, recommendation engines, and database internals.
  • Strong foundation in algorithms, data structures, and system design as applied to large-scale retrieval and data systems.
  • Proven ability to deliver technically complex, high-impact initiatives that create customer or business value.
  • Experience leading architecture for performance-sensitive, large-scale systems.
  • Strong communication skills and ability to collaborate across teams in fast-moving environments.
  • Strategic and product-oriented mindset with the ability to align technical execution with long-term vision.
  • Passion for mentoring, growing engineers, and fostering technical excellence.


Pay Range Transparency

Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page here.

Local Pay Range

$166,000-$225,000 USD

BenefitsAt Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region click here.

About Databricks

Databricks is a unified analytics platform that provides data engineering, collaborative data science, and machine learning capabilities. The company was founded in 2013 by the original creators of Apache Spark, a popular open-source big data processing engine. Databricks provides a cloud-based platform that allows data teams to collaborate and build data pipelines, run machine learning models, and perform advanced analytics. The company has raised over $1 billion in funding and is valued at $38 billion as of November 2021.
Learn more about Databricks
Size
2,000 employees
Industry
Founded
2013

Similar Jobs

More Jobs at Databricks

More Information Technology Jobs

Find similar Staff Software Engineer, AI Search jobs: