Zscaler

Sr. Staff Software Development Engineer-AI Security (Network, Security, LLM)

Zscaler$154K — $220K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 8+ years of software engineering experience
  • Deep experience in Rust systems programming with async frameworks
  • Foundational understanding of AI/ML technologies
  • Proven ability to design and implement scalable distributed systems
  • Strong command of Linux internals and performance instrumentation

Responsibilities

  • Architect and develop a low-latency AI Security plane using Rust
  • Build scalable, resilient systems emphasizing concurrency and fault tolerance
  • Implement and maintain gRPC services for integration with infrastructure
  • Enhance performance of LLM models with profiling tools
  • Lead multi-functional projects defining technical roadmaps

Benefits

  • Various health plans
  • Time off plans for vacation and sick time
  • Parental leave options
  • Retirement options
  • Education reimbursement
  • In-office perks
Full Job Description
Role

We are looking for a Sr. Staff Software Development Engineer-AI Security to join our team. This is a Hybrid (based in San Jose, CA or Bellevue, WA with a 3 days in office requirement) role, reporting to the Director of Software Engineering in the Emerging Tech department. You will be responsible for designing and implementing core infrastructure components and distributed systems, serving as a foundational architect for our AI security solution. This high-impact role focuses on scaling security infrastructure to support hundreds of millions of users, collaborating with stakeholders across the development lifecycle to drive innovation and technical excellence.

What you'll do (Role Expectations)
  • Architect, develop, and optimize a low-latency, high-throughput AI Security plane utilizing Rust, specifically leveraging its async/await model for highly efficient I/O and service-oriented architecture
  • Build resilient, distributed, and scalable systems, emphasizing concurrency, fault tolerance, and robust messaging protocols
  • Implement and maintain gRPC services and APIs to ensure seamless integration of the AI Security plane with control and orchestration infrastructure
  • Systematically enhance performance across the entire stack, including LLM models, by employing profiling tools for both kernel-space and user-space components
  • Lead complex, multi-functional projects and initiatives, defining the technical roadmap and driving execution across teams

Who You Are (Success Profile)
  • You thrive in ambiguity. You're comfortable building the path as you walk it. You thrive in a dynamic environment, seeing ambiguity not as a hindrance, but as the raw material to build something meaningful.
  • You act like an owner. Your passion for the mission fuels your bias for action. You operate with integrity because you genuinely care about the outcome. True ownership involves leveraging dynamic range: the ability to navigate seamlessly between high-level strategy and hands-on execution.
  • You are a problem-solver. You love running towards the challenges because you are laser-focused on finding the solution, knowing that solving the hard problems delivers the biggest impact.
  • You are a high-trust collaborator. You are ambitious for the team, not just yourself. You embrace our challenge culture by giving and receiving ongoing feedback-knowing that candor delivered with clarity and respect is the truest form of teamwork and the fastest way to earn trust.
  • You are a learner. You have a true growth mindset and are obsessed with your own development, actively seeking feedback to become a better partner and a stronger teammate. You love what you do and you do it with purpose.

What We're Looking for (Minimum Qualifications)
  • Foundational understanding of AI/ML technologies and experience leveraging, securing, or positioning AI-driven solutions to optimize outcomes within your functional domain
  • 8+ years of software engineering experience
  • Deep experience in systems programming using Rust, with a focus on asynchronous frameworks such as Tokio or async-std
  • Proven ability to design and implement horizontally scalable, highly available, and observable distributed systems
  • Strong command of Linux internals (including kernel-user space interaction, networking, sockets, and namespaces) combined with skill in performance instrumentation, containerized environments, Git workflows, and CI/CD pipelines

What Will Make You Stand Out (Preferred Qualifications)
  • Experience architecting real-time threat detection, input/output sanitization, or guardrail execution frameworks specifically tailored for protecting LLM and generative AI applications
  • Expert in systems languages such as C/C++ or Rust with a focus on performance optimization, including deep understanding of Linux networking stacks, Kubernetes networking, service meshes, and LLM model optimization
  • Practical experience with gRPC, Protobufs, and L4-L7 networking protocols, including TCP/IP, TLS, QUIC, HTTP, and WebSockets (WSS)

#LI-Hybrid #LI-YC2

Zscaler's salary ranges are benchmarked and are determined by role and level. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations and could be higher or lower based on a multitude of factors, including job-related skills, experience, and relevant education or training.

The base salary range listed for this full-time position excludes commission/ bonus/ equity (if applicable) + benefits.

Base Pay Range

$154,000-$220,000 USD

Our Benefits program is one of the most important ways we support our employees. Zscaler proudly offers comprehensive and inclusive benefits to meet the diverse needs of our employees and their families throughout their life stages, including:

  • Various health plans
  • Time off plans for vacation and sick time
  • Parental leave options
  • Retirement options
  • Education reimbursement
  • In-office perks, and more!


Learn more about Zscaler's hybrid working model and benefits here.

About Zscaler

Zscaler is a cloud-based information security company that provides Internet security, web security, firewalls, sandboxing, SSL inspection, antivirus, vulnerability management and granular control of user activity in cloud computing, mobile and Internet of things environments. The company is headquartered in San Jose, California, and has offices in Australia, India, Japan, Singapore, the United Kingdom, and the United States.
Learn more about Zscaler
Size
3,153 employees
Market Cap
$15.5 billion
Industry
Net Income
-$191.4 million
Founded
2008
5 Year Trend
+54.1%
Revenue
$536 million
NASDAQ

Similar Jobs

More Jobs at Zscaler

More Information Technology Jobs

Find similar Sr. Staff Software Development Engineer-AI Security (Network, Security, LLM) jobs: