Job DescriptionDo you want to shape reliability practices for a new AI inference platform?Are you a senior technical leader who drives solutions across teams?Join the Akamai Inference Cloud Team!The Akamai Inference Cloud team is part of Akamai's Cloud Technology Group. We design, implement, deploy and operate AI platforms that enable customers to run inference models and developers to create AI applications.
Partner with the bestIn this role, you'll lead reliability workstreams for Akamai's serverless inference platform, design SRE tooling and automation, and drive technical decisions. Opportunities exist to mentor other SREs, influence architecture decisions with product engineering teams, and shape SRE practices for AI inference workloads and GPU infrastructure at scale.
As a Senior II Site Reliability Engineer, you will be responsible for:
- Taking ownership of observability strategy for the serverless inference platform, designing telemetry, dashboards, and alerts, defining SLO/SLI frameworks, and driving improvements when targets are missed
- Building production-grade automation and tooling that reduces operational toil, improves incident response, and sets patterns that other SREs adopt
- Owning incident management integration for inference workloads, designing frameworks, leading incident response during on-call rotations, and driving systemic improvements from post-mortems
- Defining and implementing deployment safety practices including progressive rollouts, canary analysis, and rollback automation, establishing standards for the team
- Partnering with product engineering teams to influence architecture decisions, ensure operational readiness, and represent the SRE perspective in design reviews
- Mentoring Senior and mid-level SREs through code reviews, design discussions, and hands-on problem-solving
Do what you loveTo be successful in this role you will:
- 8+ years of experience in SRE, infrastructure engineering, or platform engineering, working with large-scale distributed systems
- Possess a proven track record of defining SLO/SLI frameworks, building observability platforms, and running incident management processes at scale
- Have extensive Kubernetes and containerization experience at scale, including autoscaling, resource scheduling, and container orchestration for compute-intensive workloads
- Have experience building automation and tooling in Python or Go, with familiarity in CI/CD pipelines, deployment safety, and infrastructure-as-code
- Possess the ability to lead technical initiatives across teams, mentor other engineers, and drive complex reliability problems to resolution independently
- Have experience with or exposure to AI/ML infrastructure, model serving, or GPU workloads
CompensationAkamai is committed to fair and equitable compensation practices. For US based candidates only - the base salary for this position ranges from $146,400 - $263,600/year; a candidate's salary is determined by various factors including, but not limited to, relevant work experience, skills, certifications and location. Compensation for candidates outside the US will vary. The compensation package may also include incentive compensation opportunities in the form of annual bonus or incentives, equity awards and an Employee Stock Purchase Plan (ESPP). Akamai provides industry-leading benefits including healthcare, 401K savings plan, company holidays, vacation (in the form of PTO), sick time, family friendly benefits including parental leave and an employee assistance program including a focus on mental and financial wellness; Eligibility requirements apply.
