Distributed Software Engineer

Cerebras Systems

• $125K — $150K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience in production distributed systems or infrastructure software
  • Proficient in Go and Python for building production-quality applications
  • Deep understanding of Kubernetes, including controllers, operators, CRDs, and RBAC
  • Strong troubleshooting skills in distributed systems, Linux, and networking
  • Experience with Prometheus and Grafana, including alerting and exporter design
  • Ability to work independently in a complex, fast-paced environment with minimal documentation
  • Experience integrating AI tools into engineering practices

Responsibilities

  • Automate bare-metal networking, OS, and software deployment across large clusters
  • Facilitate cluster installations, upgrades, and patches with controlled downtime
  • Develop Kubernetes operators to manage resource scheduling and workload prioritization
  • Build gRPC services for multi-tenant management and security policies
  • Create metrics and logging pipelines tailored for large-scale systems
  • Implement automated recovery and failure detection using CLIs and APIs
  • Expose fleet operations to users, operators, and AI systems through robust interfaces

Benefits

  • Opportunity to work on cutting-edge technology in cloud infrastructure and AI
  • Collaborative and innovative team environment
  • Chance to contribute to large-scale system architecture
  • Professional growth through exposure to advanced engineering practices
  • Access to high-performance computing and distributed systems
Full Job Description
The Role

The Cluster engineering team owns the software that turns thousands of wafers, servers, and switches into a cloud that stays up, stays busy, and stays debuggable. We stand clusters up from bare metal, schedule training and inference workloads across the fleet, keep it healthy, and make it observable to users, operators, and increasingly to AI agents. The stack is Go and Python on Kubernetes, running both on-premise deployments and our own cloud.

Responsibilities
• Declarative, CRD-driven automation of bare-metal networking, OS, and application software across clusters of Cerebras systems, servers, and switches, built to reconcile thousands of nodes
• Push-button cluster install, upgrade, and security patching with real downtime budgets, gated by canaries
• Kubernetes operators that schedule large inference workload: resource locks, priority queues, network topology, and health-aware placement
• gRPC control-plane services, authorization, admission webhooks, and quota policy for a multi-tenant fleet
• Metrics and log pipelines with purpose-built exporters for wafer-scale systems, servers (Redfish, IPMI), and network fabric (gNMI, sFlow), on Prometheus and Grafana, with SLOs and alerting
• Failure detection, HA control planes, and automated recovery, plus the CLIs, APIs, and MCP gateway that expose the fleet to users, operators, and AI agents

Skills and Qualifications
• 5+ years building and operating production distributed systems or infrastructure software
• Production-quality Go and Python
• Real Kubernetes depth: you have written or debugged controllers and operators, and you understand CRDs, reconciliation semantics, informer caches, admission webhooks, and RBAC
• Strong debugging skills across distributed systems, Linux, and networking
• Prometheus and Grafana as a practitioner: PromQL, exporter design, cardinality discipline, useful alerts
• Strong self-driving capability. This environment is large, fast-moving, and not fully documented, so we need engineers who build their own context, decide, and drive work across team boundaries. Learning speed matters more here than familiarity with our stack.
• Demonstrated adoption of AI in your engineering workflow: active use of coding agents, a view on where they help and where they mislead, and the rigor to verify what they produce.
• Nice to have: bare-metal or HPC fleet operations, scheduler internals, RDMA/RoCE and eBPF networking, Ceph or NVMe-oF, etcd and HA upgrades, inference serving stacks. ML research experience is not required.

Apply today and become part of the forefront of groundbreaking advancements in AI!

Similar Jobs

More Jobs at Cerebras Systems

More Information Technology Jobs

Find similar Distributed Software Engineer jobs: