OpenAI

Software Engineer, Caching Infrastructure

OpenAI • $150K — $180K *
San Francisco, CA 94112In-Person
Information Technology
5 - 7 years of experience
Today
Be an Early Applicant
Job Overview by Ladders

Qualifications

  • 5+ years of experience in building and scaling distributed systems
  • Expertise with Redis, Memcached, or similar caching solutions
  • Experience with Kubernetes and service meshes like Envoy
  • Knowledge of system performance tuning
  • Ability to analyze latency, reliability, throughput, and cost

Responsibilities

  • Design and operate OpenAI's caching platform for various product experiences
  • Define the long-term vision and roadmap for caching infrastructure
  • Collaborate with infrastructure and product teams to meet platform needs
  • Balance performance, durability, and cost in platform design
  • Ensure scalability across multiple tenants

Benefits

  • Collaborative work environment with cross-functional teams
  • Opportunity to influence core infrastructure capabilities
  • Focus on cutting-edge technology and innovative problem-solving
  • Fast-paced work setting that emphasizes pragmatic engineering
  • Engagement in a mission-driven organization dedicated to AI advancement
Full Job Description
In This Role, You Will:
  • Design, build, and operate OpenAI's multi-tenant caching platform used across inference, identity, quota, and product experiences.
  • Define the long-term vision and roadmap for caching as a core infra capability, balancing performance, durability, and cost.
  • Collaborate with other infra teams (e.g., networking, observability, databases) and product teams to ensure our caching platform meets their needs.
You Might Thrive In This Role If You:
  • Have 5+ years of experience building and scaling distributed systems, with a strong focus on caching, load balancing, or storage systems.
  • Have deep expertise with Redis, Memcached, or similar solutions, including clustering, durability configurations, client-side connection patterns, and performance tuning.
  • Have production experience with Kubernetes, service meshes (e.g., Envoy), and autoscaling systems.
  • Think rigorously about latency, reliability, throughput, and cost in designing platform capabilities.
  • Thrive in a fast-paced environment and enjoy balancing pragmatic engineering with long-term technical excellence.


About OpenAI

OpenAI is an artificial intelligence research laboratory consisting of the for-profit corporation OpenAI LP and its parent company, the non-profit OpenAI Inc. The company was founded in 2015 by a group of technology leaders, including Elon Musk, Sam Altman, Greg Brockman, Ilya Sutskever, and John Schulman. OpenAI's mission is to develop and promote friendly AI for the betterment of humanity. The company has developed a number of cutting-edge AI technologies, including GPT-3, a language processing system that can generate human-like text. OpenAI has received funding from a number of high-profile investors, including LinkedIn co-founder Reid Hoffman and venture capitalist Peter Thiel.
Learn more about OpenAI
Size
100 employees
Industry
Information Technology
Founded
2015
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at OpenAI

More Information Technology Jobs

Find similar Software Engineer, Caching Infrastructure jobs:

NationwideSan Francisco, CA