About the Role:Stack AV Site Reliability Engineers are responsible for enabling and ensuring our production systems meet their service-level objectives. Through the implementation of centralized observability and automation, the SRE team constantly ensures the health, reliability, scalability, and performance of Stack AV's infrastructure.
In this SRE role, you will be ensuring the robustness and operational readiness of the compute platform that powers large-scale autonomous systems development. The team is responsible for enabling engineers and researchers to efficiently run compute and data intensive workloads on StackAV infrastructure.
The Compute Platform team is responsible for designing and operating the systems that orchestrate and scale batch and distributed workloads across our environments. You will work at the intersection of infrastructure, distributed systems, and developer experience-ensuring that complex workloads are reliable, efficient, and easy to run.
As a Compute Platform SRE, you help be responsible for ensuring the operational readiness and maturity of high scale batch compute systems and workflow orchestration systems that power engineers across the company.
Responsibilities:- Instrument systems scheduling and executing large-scale batch workloads across Kubernetes clusters.
- Diagnose and triage job failures for customers.
- Collaborate with teams across the company to understand workload requirements and improve platform capabilities.
- Scale the reliability and velocity of our systems and processes through increased automation.
- Document actions to build a comprehensive library of runbooks, which will act as a knowledge base and foundation for automation.
- Participate in an on-call rotation to uphold the SLOs and SLAs of production services.
- Contribute to platform tooling, automation, and CI/CD workflows.
Qualifications: - Fundamental understanding of Linux operating system internals, TCP/IP networking, and storage subsystems.
- Strong experience with Kubernetes and container orchestration in production grade environments.
- Understanding of engineering design limitations and ability to provide guidance to teams to scale their services to achieve desired performance within budget.
- Strong experience implementing and debugging cloud native and open source tools such as Kubernetes, etcd, Prometheus, OpenTelemetry.
- Strong communication skills and the ability to work effectively in a diverse and distributed team.
