Lambda

Senior Software Engineer - Storage Control Plane

Lambda$150K — $180K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's or Master's in Computer Science or related field
  • 5+ years of software development experience in storage systems
  • Expertise in distributed systems programming and concepts like load balancing and fault tolerance
  • Strong programming skills in C, C++, Go, or Python
  • Experience with Linux kernel internals and system-level programming
  • Knowledge of storage protocols (e.g. S3, NFS) and file systems like Ceph or DAOS
  • Familiarity with container technologies (Docker, Kubernetes) for production workloads

Responsibilities

  • Design and build a vendor-agnostic storage control plane
  • Define an internal abstraction layer to hide vendor-specific APIs and telemetry formats
  • Build reconciliation-loop and CRD-based orchestration for managing storage resources
  • Own multi-tenant isolation including QoS and rate limiting
  • Design a capacity and placement engine aware of PCIe topology and NUMA
  • Instrument systems for SLI/SLO tracking and performance regression detection

Benefits

  • Work in a collaborative team environment
  • Opportunity to innovate cutting-edge AI storage solutions
  • Access to advanced technologies in a high-performance setting
  • Flexible remote work policy with designated in-office days
  • Participation in a culture focused on personal and professional growth
Full Job Description
*Note: This position requires presence in our San Francisco, San Jose, or Bellevue office location 4 days per week; Lambda's designated work-from-home day is currently Tuesday.

In the world of distributed AI training and inference, raw GPU and CPU horsepower is just a part of the story. High-performance networking and storage are the critical components that enable and unite these systems, making groundbreaking AI training and inference possible.

The Lambda Infrastructure Engineering organization forges the foundation of high-performance AI clusters by welding together the latest in AI storage, networking, GPU and CPU hardware.

Our expertise lies at the intersection of:
  • High-Performance Distributed Storage Solutions and Protocols: We engineer the protocols and systems that serve massive datasets at the speeds demanded by modern clustered GPUs.
  • Dynamic Networking: We design advanced networks that provide multi-tenant security and intelligent routing without compromising performance, using the latest in AI networking hardware.
  • Compute Clustering and Virtualization: We enable cutting-edge virtualization and clustering that allows AI researchers and engineers to focus on AI workloads, not AI infrastructure, unleashing the full compute bandwidth of clustered GPUs.

AI training and inference relies on petabytes of data hosted on large, high-performance storage arrays. At Lambda, the Infrastructure Storage Team's job is to ensure that the data powering AI is fast, performant, and available across a variety of access protocols (fit for purpose).

We're looking for an experienced Senior Software Engineer to join our storage team. You'll join a team responsible for developing and implementing our next-generation storage software. This role requires expertise in distributed systems, and an in-depth understanding of file, block, and object storage protocols. You'll work on building scalable and resilient storage control plane that power our AI and machine learning infrastructure.

What You'll Do
  • Design and build a vendor-agnostic control plane that provisions, scales, heals, and meters storage across the platforms our customers actually demand, VAST Data, WEKA, DDN, Pure, NetApp, Ceph, MinIO, and the ones that don't exist yet.
  • Define the internal abstraction layer that hides vendor-specific APIs, failure semantics, QoS knobs, and telemetry formats behind one declarative interface, so a new vendor integration is a driver, not a re-architecture.
  • Build reconciliation-loop and CRD-based orchestration (Kubernetes controllers, operators, custom schedulers) that manages capacity, tenancy, encryption domains, and placement across data centers and availability zones.
  • Own multi-tenant isolation end to end: namespace and subsystem partitioning, per-tenant QoS and rate limiting, credential and key lifecycle, blast-radius containment, noisy-neighbor detection.
  • Design the capacity and placement engine: PCIe-topology-aware, NUMA-aware, failure-domain-aware. On our platforms a drive behind the same PCIe switch as the GPU it serves beats a faster drive on a different root port, and the control plane needs to know that.
  • Instrument everything: SLI/SLO definitions, fleet-wide performance regression detection, and the observability pipeline that makes a petabyte fleet debuggable at 3 a.m.

You
  • Bachelor's or Master's degree in Computer Science or a related field.
  • 5+ years of experience in software development for storage systems.
  • Proven experience with distributed systems programming and concepts such as load balancers, data-durability, consensus algorithms, fault tolerance, and data consistency.
  • Strong programming skills in languages such as C, C++, Go, or Python.
  • Experience with Linux kernel internals and system-level programming.
  • Experience with one or more storage protocols (e.g. S3, NFS) and file systems such as Ceph, DAOS, or similar.
  • Familiarity with containerization technologies like Docker and Kubernetes and running production workloads in these environments.
  • Familiarity with CI/CD and QA practices for distributed systems development environments.

Nice to Have
  • Experience with AI/ML workloads and the unique storage challenges they present.
  • Knowledge of data center networking and high-speed interconnects (e.g., InfiniBand, RoCE).
  • Experience with performance tuning and optimization of storage systems.
  • Familiarity with hardware acceleration technologies, specifically GPUs and DPUs.
  • Production experience with VAST Data, WEKA, DDN, Pure, NetApp, or IBM Storage Scale.
  • Ceph at 100 PB+ in HPC or AI environments.
  • CXL memory pooling, computational storage, ZNS SSDs, EDSFF.
  • Published or presented at SNIA SDC, FAST, USENIX ATC, LSFMM+BPF, OCP, SC, or similar.

Salary Range Information

The annual salary range for this position has been set based on market data and other factors. However, a salary higher or lower than this range may be appropriate for a candidate whose qualifications differ meaningfully from those listed in the job description.

About Lambda

Lambda is an online education company that offers courses in computer science and software engineering. The company was founded in 2017 by Austen Allred and Ben Nelson. Lambda's courses are designed to be accessible to anyone, regardless of their background or prior experience. The company's mission is to provide high-quality education that leads to well-paying jobs in the tech industry. Lambda has partnerships with a number of companies, including Amazon, Google, and Microsoft, and has helped thousands of students launch careers in tech.
Learn more about Lambda
Size
1,000 employees
Industry
Net Income
-$5 million
Founded
2017
5 Year Trend
+100%
Revenue
$100 million
NASDAQ

Similar Jobs

More Jobs at Lambda

More Information Technology Jobs

Find similar Senior Software Engineer - Storage Control Plane jobs: