Box Inc

Machine Learning Engineer III, Search Relevance

Box Inc$175K — $219K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 3+ years in backend or distributed systems with service ownership experience.
  • Proficient in Java, Scala, C++, or Python; production-grade Python is a plus.
  • Familiar with search, ranking, or applied ML workflows.
  • Experience with data pipelines or streaming systems like Kafka; real-time processing knowledge.
  • Knowledge of cloud-native microservices and CI/CD practices.
  • BS in Computer Science or related field, or equivalent experience.
  • Metrics-driven mindset with a focus on experimentation and collaboration.

Responsibilities

  • Design and enhance ranking, retrieval, and recommendation systems for better relevance and performance.
  • Implement production features utilizing embeddings and semantic search techniques with guidance.
  • Conduct offline/online evaluations and A/B tests, using metrics like NDCG and MRR.
  • Develop observable microservices and real-time indexing solutions within distributed frameworks.
  • Own projects from concept to implementation, ensuring clear documentation and operational readiness.
  • Enhance data and feature pipelines for optimal performance and quality.
  • Contribute to team best practices and documentation to elevate code quality and reliability.

Benefits

  • Flexible work environment with a requirement of 3 days in-office collaboration.
  • Commitment to diverse and equitable hiring practices.
  • Opportunities for equity and benefits based on fair compensation practices.
Full Job Description
Search Relevance team at Box powers discovery across billions of files, enabling customers to find the right content quickly, securely, and intelligently. As we expand into a new era of AI-powered content understanding, were investing in the foundation that makes great search possible: reliable systems, strong signals, and models that learn from real-world usage.

This is a rare opportunity to work at the intersection of information retrieval science, applied machine learning, and large-scale distributed systems. Youll be building the infrastructure that powers intelligent content discovery for Fortune 500 companies-where milliseconds matter, relevance is measurable, and your experiments directly impact how millions of users work.

Were looking for a Machine Learning Engineer III to improve search quality end-to-end-signals, ranking, retrieval, and evaluation-while building scalable, low-latency services that serve queries in real time. Youll collaborate with senior engineers, Product, Data, and Infra partners to productionize modern retrieval techniques and experimentation frameworks that directly impact how millions of users work.
WHAT YOULL DO
  • Design, build, and iterate on components for ranking, retrieval, and recommendations that improve measurable relevance and latency.
  • Implement production features leveraging embeddings, semantic/hybrid search, and LLM-enabled retrieval under mentorship and design guidance.
  • Contribute to offline/online evaluation, A/B tests, and relevance tuning using metrics such as NDCG, MRR, and precision@k.
  • Develop reliable, observable microservices and near real-time indexing pipelines across distributed systems.
  • Own well-scoped projects from design to rollout, writing clear design docs, tests, and operational runbooks.
  • Improve data and feature pipelines (batch/streaming) to ensure quality, freshness, and end-to-end performance.
  • Document patterns and contribute to team best practices that raise the bar on code quality and reliability.
  • Participate in our on-call rotation, available at all times while on-call to help respond to and triage any issues that arise.
WHO YOU ARE
  • 3+ years of industry experience building backend or distributed systems, with production ownership of services or data pipelines.
  • Proficient in at least one of: Java, Scala, C++, or Python; comfortable writing production-grade Python is a plus.
  • Exposure to search, ranking, recommendations, or applied ML in production; understand the basics of training-to-serving workflows.
  • Experience with data pipelines, message queues, or streaming systems (e.g., Kafka, Pub/Sub) and near real-time processing.
  • Familiarity with cloud-native microservices, CI/CD, observability, and performance tuning.
  • BS in Computer Science or related field, or equivalent practical experience.
  • Pragmatic, metrics-driven mindset-eager to experiment, measure impact, and iterate quickly in collaboration with partners.

Preferred
  • Experience with Elasticsearch, Solr, Lucene, or custom search systems; understanding of inverted indexes and scoring functions.
  • Knowledge of relevance tuning, learning-to-rank concepts, and offline/online experimentation practices.
  • Exposure to vector search, dense/sparse embeddings, and hybrid retrieval architectures.
  • Familiarity with IR fundamentals (BM25, TF-IDF, multi-stage retrieval) and query understanding.
  • Experience with Kubernetes/Terraform and a major cloud (GCP/AWS/Azure).
  • Practical exposure to PyTorch or TensorFlow; LLM familiarity helpful but not required.

Box lives its values, with community and in-person collaboration being a core part of our culture. Boxers are expected to work from their assigned office a minimum of 3 days per week.Your Recruiter will share more about how we work and company culture during the hiring process.

At Box, we believe unique and diverse experiences benefit our culture, our products, our customers, our company, and our world. We aim to recruit a passionate, high-performing workforce that reflects the world we live in.If you are head-over-heels about this role but unsure if you meet all the requirements, we encourage you to apply!

Box is committed to fair and equitable compensation practices. Actual base salary (or OTE if commissionable role) is dependent upon factors such as: knowledge, skill level, experience, and work location. This role is also eligible for equity and benefits. For more information, check out our benefits and perks.

United States Pay Range

$175,500-$219,500 USD

About Box Inc

Box, Inc. is a cloud content management and file sharing service for businesses. The company provides a platform for managing and collaborating on content across multiple devices and applications. Box serves a wide range of industries, including healthcare, finance, and media. The company was founded in 2005 and is headquartered in Redwood City, California.
Learn more about Box Inc
Size
2,172 employees
Market Cap
$4.4 billion
Industry
Net Income
-$43.4 million
Founded
2005
5 Year Trend
+17%
Revenue
$770.7 million
NASDAQ

Similar Jobs

More Jobs at Box Inc

More Information Technology Jobs

Find similar Machine Learning Engineer III, Search Relevance jobs: