JOB SUMMARY
The Private Cloud Kubernetes SRE team is responsible for implementing and managing the on-premise Kubernetes infrastructure. This distributed global team is involved in evaluation, certification, integration and maintenance of various products, including hardware, Operating Systems, such as CoreOS and RedHat's OpenShift, system services, 3rd party vendor products, Virtualization technologies and a variety of in-house developed tools. The role is critical to day-to-day incident management function with primary responsibilities for diagnosis and resolution of immediate production impacting issues in the on-premises Kubernetes compute plant.
Key Responsibilities
• Diagnosis and resolution of immediate production impacting issues in the on-premises Kubernetes compute plant
• Working with other infrastructure teams including networking, storage, security, database, and hosted solution teams for outage resolution, as well as customers aligned with the business users of our plant to determine scope, impact, and appropriate resolution path
• Carry out proactive health & hygiene tasks to maintain operational stability and compliance for risk & control programs to ensure the production environment is not put at risk
• Collaborate with engineering teams to test and certify new hardware & software products
• Be part of the on-call rotation supporting firms production systems
• Occasional weekend project work responsibilities to on-board new assets for growth or large programs such as new datacenter build outs
• Ability to read complex code and write scripts using Shell, Python, Go etc.
Required Qualifications
• Strong hands-on experience administering and troubleshooting Kubernetes platforms, preferably Red Hat OpenShift
• Strong Linux systems-administration and troubleshooting skills across operating systems, processes, filesystems, networking and storage
• Experience providing production support and participating in a global on-call rotation for highly available services
• Strong understanding of TCP/IP, DNS, HTTP/HTTPS, TLS, load balancing and Kubernetes networking
• Experience with Kubernetes resources including pods, deployments, StatefulSets, services, ingress, namespaces, RBAC, resource controls and NetworkPolicy
• Experience with Git, CI/CD and GitOps-based infrastructure or application delivery
• Have administrative competence in at least one major scripting language or platform (for example Python and/or Go)
• Experience with incident, problem, change and release management
• Experience with monitoring, metrics, logging, alerting and production troubleshooting in Kubernetes and Linux environments
• Experience with Agile and DevOps/SRE concepts
• Strong written and verbal communication skills, including collaboration with global engineering, security, network, storage and application teams
Preferred Qualifications
• Experience operating in large, enterprise environments
• Red Hat Advanced Cluster Management or another multi-cluster management platform
• Prometheus, Grafana and OpenTelemetry
• Ansible or Ansible Automation Platform
• Istio or another Kubernetes service mesh
• Bare-metal server, firmware and out-of-band management experience
• Experience with secrets and certificate management, including HashiCorp Vault
• Experience with container image inspection tools such as Skopeo and vulnerability scanners such as Trivy, Clair or Grype or equivalent
• Experience with maintaining high-availability production systems