AI Software Engineer - Search Infrastructure

$151K — $332K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree with 4+ years in backend or distributed systems engineering
  • Experience using AI tools effectively with a productivity mindset
  • Proven track record in designing and operating large-scale data ingestion pipelines
  • Experience in building highly available, multi-tenant backend services
  • Familiarity with document-level permission modeling and secure data handling
  • Proficient with cloud-native tools like Docker, Kubernetes, and AWS
  • Experience with Go is a bonus
  • Background in integrating with SaaS platforms like Google Workspace and Microsoft 365

Responsibilities

  • Design and implement a scalable RAG system for real-time Q&A
  • Build robust ingestion and indexing pipelines with permission-aware access control
  • Develop APIs and backend systems for efficient querying and retrieval
  • Collaborate with ML/NLP engineers to improve search quality
  • Ensure reliability and scalability across the retrieval and augmentation stack
  • Monitor system performance and optimize for real-world workloads

Benefits

  • Award-winning workplace culture
  • Supports physical, mental, emotional, and financial health
  • Options to help maintain work-life balance
  • Contributes to community involvement opportunities
  • Structured hybrid work approach
Full Job Description

AI Software Engineer - Search Infrastructure

What you can expect

We’re building the next-generation AI-native knowledge platform to help organizations easily access and retrieve internal knowledge using the power of LLMs. You’ll join a fast-moving engineering team to build scalable, secure, and intelligent Retrieval-Augmented Generation (RAG) infrastructure — powering enterprise search, AI assistants, and knowledge discovery experiences.

Responsibilities

  • Designing and implementing a scalable RAG system for real-time Q&A across internal content (meetings, messages, documents, whiteboards, videos, etc.).

  • Building robust ingestion and indexing pipelines for semi-structured data sources with fine-grained, permission-aware access control.

  • Developing APIs and backend systems to enable efficient querying, retrieval, and ranking.

  • Collaborating with ML/NLP engineers to iterate on embedding models and improve search quality.

  • Ensuring reliability, low latency, and scalability across the entire data retrieval and augmentation stack.

  • Monitoring system performance and optimize for high-throughput, low-latency workloads under real-world load.

What we’re looking for

  • Have a Bachelor's degree and 4+ years of experience in backend or distributed systems engineering

  • Have a productivity mindset with experience using AI tools effectively

  • Have experience designing and operating large-scale data ingestion pipelines (message queues, vector stores, Temporal, Elasticsearch etc.)

  • Demonstrate a track record of building highly available, multi-tenant backend services

  • Have experience with document-level permission modeling and secure data handling

  • Possess with cloud-native tools such as Docker, Kubernetes, and AWS

  • Have experience in Go is a bonus

  • Have experience integrating with SaaS platforms (Google Workspace, Microsoft 365, Slack, etc.)

Salary Range or On Target Earnings:

Minimum:

$151,800.00

Maximum:

$332,200.00

In addition to the base salary and/or OTE listed Zoom has a Total Direct Compensation philosophy that takes into consideration; base salary, bonus and equity value.

Note: Starting pay will be based on a number of factors and commensurate with qualifications & experience.

We also have a location based compensation structure;  there may be a different range for candidates in this and other locations.

Ways of Working
Our structured hybrid approach is centered around our offices and remote work environments. The work style of each role, Hybrid, Remote, or In-Person is indicated in the job description/posting.

Benefits
As part of our award-winning workplace culture and commitment to delivering happiness, our benefits program offers a variety of perks, benefits, and options to help employees maintain their physical, mental, emotional, and financial health; support work-life balance; and contribute to their community in meaningful ways. Click for more information.

Similar Jobs

More Jobs at

More Information Technology Jobs

Find similar AI Software Engineer - Search Infrastructure jobs: