Coupang

Sr. Director, AI Infrastructure

Coupang • $184K — $376K *
Mountain View, CA 94040In-Person
Information Technology
11 - 15 years of experience
Today
Be an Early Applicant
Job Overview by Ladders

Qualifications

  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.
  • 15+ years in software engineering, infrastructure, or platform operations.
  • 5+ years in a leadership role, ideally at Director or Sr. Director level.
  • Expertise in large-scale distributed systems and cloud-native architectures.
  • Hands-on experience with AI infrastructure orchestration like Kubernetes and Kubeflow.
  • Knowledge of infrastructure as code and automation across various Linux environments.
  • Excellent communication and cross-group collaboration skills.

Responsibilities

  • Define and execute the long-term vision for AI infrastructure orchestration.
  • Lead and mentor a high-performing engineering and operations team.
  • Manage the budget and resources for AI infrastructure deliverables.
  • Oversee the design and implementation of core orchestration platforms for AI model training.
  • Ensure the reliability, security, and compliance of AI infrastructure.
  • Establish and optimize Service Level Objectives (SLOs) and Key Performance Indicators (KPIs).
  • Select and integrate technologies for the AI stack, promoting infrastructure-as-code principles.

Benefits

  • Medical, Dental, Vision, and Life insurance.
  • Flexible Spending Accounts (FSA) & Health Savings Account (HSA).
  • Long-term and short-term disability insurance.
  • Employee Assistance Program (EAP).
  • 401K plan with company match.
  • 18-21 days of paid time off (PTO) based on tenure.
  • 12 public holidays and paid parental leave.
Full Job Description
Sr. Director Back-end Engineering - AI Infrastructure Orchestration

Role Overview

Strategy and Leadership
  • Define and execute the long-term vision and roadmap for the company's AI infrastructure orchestration layer, aligning it with overall business and AI Services goals.
  • Lead, mentor, and grow a high-performing engineering and operations team focused on AI infrastructure, and platform engineering.
  • Manage budget and resource allocation for AI infrastructure delievrables.
  • Act as a key liaison between AI Infra and other services owners and consumers, core engineering, Cloud infrastructure, and executive leadership.
AI Infra Development and Operations
  • Oversee the design, implementation, and maintenance of the core orchestration platforms for large-scale AI model training (e.g., distributed training, hyperparameter tuning) and deployment (e.g., containerization, serverless functions, edge deployment).
  • Ensure reliability, security, and compliance of the AI infrastructure, meeting strict standards for data governance and model integrity.
  • Establish Service Level Objectives (SLOs) and Key Performance Indicators (KPIs) for the AI platform services and lead efforts for continuous optimization and performance tuning.

Success Metrics

A successful Senior Director - AI Infrastructure Orchestration will be measured by:
  • The time-to-market for AI Infar build, scale and operate
  • The resource utilization rate and cost efficiency of the AI compute infrastructure.
  • The reliability and uptime of the core AI platform services.
  • The talent retention and development within the AI Infrastructure team.
Technology and Architecture
  • Select, evaluate, and integrate the core technologies required for the AI stack (e.g., Kubernetes, Kubeflow, Ray, ML frameworks, GPU/accelerator management, distributed file systems).
  • Champion infrastructure-as-code (IaC) principles to manage and provision AI resources consistently and at scale.
Basic Qualifications

Education: Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field.

Experience:
  • 15+ years of progressive experience in software engineering, infrastructure, or platform operations.
  • 5+ years of experience leading and managing technical teams, ideally in a Director or Sr. Director level or equivalent capacity.
  • Deep, hands-on experience designing and operating large-scale distributed systems and cloud-native architectures
  • Proven experience specifically with AI infrastructure orchestration (e.g., using Kubernetes, Kubeflow, or similar MLOps tools) and managing acceleratedcompute resources (GPUs, TPUs etc).
  • 15+ years of Cloud backend engineering, Cloud Design, Deployment, DevOps
  • 15+ years of experience leading system design, architecture leveraging Private Clouds and AWS and/or Azure/ GCP.
  • 10+ years of demonstrable building and operating infrastructure as code. Infra Automation, Comfortable with many flavors of Linux
  • 15+ year's of experience in building high-performance, highly-available and scalable distributed systems in the cloud.
  • 15+ year's of experience in building and managing high-performance, highly-available and scalable Hybrid Cloud cloud environments .
  • Excellent cross-group collaboration, outstanding verbal and written communication.

Skills:
  • Expert-level knowledge of containerization and orchestration (Docker, Kubernetes).
  • Strong background in DevOps and MLOps principles and tooling.
  • Proficiency in at least one modern programming language (e.g., Python, Go).
  • Exceptional strategic planning, organizational, and written/verbal communication skills.
Preferred Qualifications:
  • Prior experience managing infrastructure for training and inferecning of large language models (LLMs) or foundation models.
  • Experience in a regulated industry with strict compliance requirements.
  • AI Private Cloud -Building and operating

Pay & Benefits:

Our compensation reflects the cost of labor across several US geographic markets. At Coupang, your base pay is one part of your total compensation.

The base pay for this position ranges from $184,000/year in our lowest geographic market to $376,000/year in our highest geographic market. Pay is based on several factors including market location and may vary depending on job-related knowledge, skills, and experience.

General Description of All Benefits:
  • Medical/Dental/Vision/Life, AD&D insurance
  • Flexible Spending Accounts (FSA) & Health Savings Account (HSA)
  • Long-term/Short-term Disability
  • Employee Assistance Program (EAP) program
  • 401K Plan with Company Match
  • 18-21 days of the Paid Time Off (PTO) a year based on the tenure
  • 12 Public Holidays
  • Paid Parental leave
  • Pre-tax commuter benefits
  • MTV - [Free] Electric Car Charging Station

General Description of Other Compensation:

"Other Compensation" includes, but is not limited to, bonuses, equity, or other forms of compensation that would be offered to the hired applicant in addition to their established salary range or wage scale.

Details to Consider
  • This job posting may be closed prior to the stated end date for application if all openings are filled.
  • Coupang has the right to rescind an offer of employment if a candidate is found to have submitted false information as part of the application process.
  • Those eligible for employment protection (recipients of veteran's benefits, the disabled, etc.) may receive preferential treatment for employment in accordance with applicable laws.

About Coupang

Coupang is a South Korean e-commerce company based in Seoul, South Korea, and incorporated in Delaware, United States. Founded in 2010 by Bom Kim, the company expanded to become the largest online marketplace in South Korea. Its expansion led the company to the video streaming distribution after the launch of the service Coupang Play. Coupang is often referred to as the "Amazon of South Korea", due its position and corporate size in South Korean online market.

Coupang Careers

Join the vibrant team at Coupang, one of the largest and most innovative e-commerce platforms in the world. At Coupang, we are not just a company; we are a revolution in online shopping, dedicated to transforming the customer experience through bold innovation and leadership in the digital landscape.

Work You’ll Do

Embark on a career journey with Coupang, where job opportunities abound to elevate your professional life. Whether you're seeking an entry-level position or a leadership role, Coupang offers a dynamic environment for growth and advancement.

Innovate and Lead

At Coupang, innovation isn't just another buzzword—it's the cornerstone of our operations. Join our team and contribute to projects that redefine the norms of e-commerce. With a focus on rapid delivery and customer satisfaction, your work will directly impact millions of lives every day.

Diversity and Inclusion

We believe that diversity fuels innovation. Coupang is committed to creating a diverse work environment where everyone, from any background, can thrive. Our diversity training ensures that all team members are valued and understood, fostering an inclusive culture that supports professional and personal growth.

Grow Your Career

Coupang is the perfect place to future-proof your career. We support our employees with unmatched training, development programs, and opportunities for upward mobility. From internships to full-time positions, every role at Coupang is designed to enhance your skills and push the boundaries of what you can achieve.

Be Part of Our Team

Our team at Coupang is composed of passionate, curious, and innovative professionals. We are hiring individuals who are not only looking to advance their careers but also to make a significant impact on the industry. Join us and be part of a team that values creativity and solution-driven mindsets.

Benefits and Culture

Coupang offers a competitive package of benefits that address the diverse needs of our employees. From health and wellness to financial planning, we ensure our team is equipped to lead a balanced life. Experience our culture where work-life balance is not just promised but practiced.

Networking and Professional Development

Networking at Coupang opens doors to expansive career opportunities. Connect with leaders and peers within the company through various networking events and collaborative projects. Our commitment to your career development is reflected in our continuous learning initiatives and professional growth activities.

Explore Job Opportunities

Are you ready to take the next step in your career? Explore the numerous job opportunities at Coupang, from customer service to tech innovation. Check out our current openings and find where your skills and interests align with our needs.

Stay Connected

Keep up to date with the latest at Coupang by following our careers blog. Gain insider perspectives and industry-leading insights that you can apply to your professional life today.

Apply Now

Ready to make a significant impact? Submit your resume, complete your profile, and prepare for an interview where you can showcase your unique abilities. At Coupang, your next great job opportunity awaits.

SEARCH COUPANG JOBS

Join Coupang and be part of a forward-thinking company that prides itself on leadership, innovation, and a commitment to the careers of its employees.
Learn more about Coupang
Market Cap
$27.5 billion
Industry
Consumer Technology
Founded
2010
5 Year Trend
+61.5%
NASDAQ
CPNG
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at Coupang

More Information Technology Jobs

Find similar Sr. Director, AI Infrastructure jobs:

NationwideMountain View, CA