Snowflake Computing

Staff Software Engineer, Cortex AI Infrastructure

Snowflake Computing$130K — $180K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science or related field
  • 5+ years of experience in distributed systems or backend infrastructure for AI/ML
  • Deep proficiency in Go or Java and Python
  • Strong understanding of database internals and cloud-native architecture
  • Familiarity with vector indices and scalable data pipelines

Responsibilities

  • Architect agentic runtimes for executing complex workflows
  • Design systems for high-performance RAG including vector database integration
  • Develop infrastructure for massive-scale golden set simulations and error analysis
  • Collaborate with modeling team to productionize AI workflows into microservices
  • Direct strategy for optimizing AI performance and cost efficiency

Benefits

  • Comprehensive health coverage
  • Retirement savings plan with employer match
  • Flexible work-from-home options
  • Continuous learning and development opportunities
  • Generous paid time off policy
Full Job Description
The Cortex Apps team is building the future of AI for enterprise data. This role focuses on the backend infrastructure that powers our flagship products like Snowflake Intelligence, Cortex Agents and Search making agentic AI fast, reliable, scalable and secure at the enterprise level.

You won't just be using AI tools; you will be building the high-performance systems that orchestrate them. You'll own and influence the architecture for agent execution environments, high-throughput context retrieval, or the ecosystem that allows our customers to iterate and launch agents in production.
What you will do in this role:
  • Architect Agentic Runtimes: Build and scale the orchestration engines that execute complex agentic workflows, ensuring low-latency tool execution and robust state management.
  • Scale Context Engineering Infra: Design high-performance systems for RAG (Retrieval-Augmented Generation), including vector database integration, scalable and efficient search indexing, query processing, and result ranking, semantic caching, and automated metadata extraction.
  • Build the "Evals Engine": Develop the automated infrastructure required to run massive-scale golden set simulations, error analysis pipelines, and "hillclimbing" experiments.
  • Productionize AI Workflows: Collaborate with the modeling team to take raw LLM capabilities and turn them into hardened, multi-tenant microservices with strict guardrails and observability.
  • Optimize Performance & Cost: Direct the infra strategy for model routing, prompt caching, and token optimization to ensure Snowflake's AI features are the most efficient in the industry.
Requirements:
  • Education: Bachelor's degree in Computer Science or a related technical field.
  • Experience: 5+ years of experience building distributed systems, high-throughput APIs, or backend infrastructure for AI/ML products.
  • Technical Stack: Deep proficiency in Go or Java (for systems) and Python (for AI orchestration).
  • Systems Thinking: Strong understanding of database internals, distributed state management, and cloud-native architecture (Kubernetes, FoundationDB, etc.).
  • Domain Expertise: Familiarity with the "plumbing" of AI: vector indices, agent platforms, and building scalable data pipelines.
(Bonus) Experience with:
  • Query optimization and SQL engine internals.
  • Designing multi-tenant systems that handle sensitive enterprise data at scale.
  • Developing search infrastructure for large-scale applications.
  • Direct experience with any of the subsystems outlined above.


Every Snowflake employee is expected to follow the company's confidentiality and security standards for handling sensitive data. Snowflake employees must abide by the company's data security plan as an essential part of their duties. It is every employee's duty to keep customer information secure and confidential.

Snowflake is growing fast, and we're scaling our team to help enable and accelerate our growth. We are looking for people who share our values, challenge ordinary thinking, and push the pace of innovation while building a future for themselves and Snowflake.

How do you want to make your impact?

For jobs located in the United States, please visit the job posting on the Snowflake Careers Site for salary and benefits information: careers.snowflake.com

About Snowflake Computing

Snowflake is a cloud-based data-warehousing company that was founded in 2012. The company provides a data platform that allows customers to store and analyze data using cloud-based infrastructure. Snowflake's platform is designed to be highly scalable and flexible, allowing customers to easily add or remove computing resources as needed. The company's customers include a wide range of businesses, from startups to Fortune 500 companies. Snowflake has received significant funding from investors and has been recognized as one of the fastest-growing companies in the United States.
Learn more about Snowflake Computing
Size
2,037 employees
Market Cap
$44.9 billion
Industry
Net Income
-$539.1 million
Founded
2012
Revenue
$592 million
NASDAQ

Similar Jobs

More Jobs at Snowflake Computing

More Information Technology Jobs

Find similar Staff Software Engineer, Cortex AI Infrastructure jobs: