AI Platform Engineer

Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years in platform, infrastructure, or SRE, with experience as a technical lead or staff-level IC.
  • Certified Kubernetes Administrator (CKA), Certified Kubernetes Application Developer (CKAD), or equivalent AWS certifications.
  • 3+ years in cloud-native architecture, particularly Kubernetes, across AWS, GCP, or Azure.
  • 3+ years managing complex, multi-month platform initiatives from concept to production.

Responsibilities

  • Define architectural direction for AI platform components, translating it into a prioritized roadmap.
  • Lead design on critical platform components, writing architecture decision records (ADRs) that set engineering standards.
  • Serve as the primary technical escalation point for complex engineering decisions, conducting design reviews and providing feedback.
  • Own technical execution of major platform initiatives, managing scoping, sequencing, and risk to ensure quality production.
  • Establish platform reliability strategy, defining service level objectives (SLOs) and improving operational maturity.
  • Design governance and compliance controls related to data management to meet enterprise requirements.
  • Facilitate cross-team alignment between AI engineering, product, and cloud engineering teams, communicating technical trade-offs effectively.

Benefits

  • Regular meetings with the AI Platform Engineering team for continuous engagement.
  • Focused one-on-one meetings with your manager for personalized guidance.
  • Networking opportunities with diverse Business Resource Groups.
  • Access to extensive learning resources on platforms like Degreed.
  • Valued ethics and integrity in a strong, ethical company with top industry pay and benefits.
Full Job Description
The Opportunity

MassMutual's AI Platform Engineering team is seeking an impact-driven AI Platform Engineer to serve as the technical anchor of our high-performing team. You will lead the design, deployment, set engineering standards, and drive the most complex platform initiatives from concept through production.

The Team

This is a unique opportunity to work on the team that builds and operates the platform powering MassMutual's AI initiatives. The team operates at the intersection of cloud infrastructure, AI/ML systems, and developer experience-delivering foundational capabilities that shape how the entire organization builds and deploys AI. We partner closely with AI engineering, product, and cloud engineering teams across the enterprise, and we invest in growth through a culture of peer learning, candid feedback, and shared technical standards. This team is defined by a shared commitment to engineering excellence, clear documentation, and the kind of technical leadership that makes hard problems tractable.

The Impact
  • Define architectural direction at the AI platform component level-cloud infrastructure, AI serving layers, developer tooling, and reliability strategy-and translate it into a concrete, prioritized roadmap.
  • Lead design on one of the platform's most critical components-LLM gateway, multi-tenant compute isolation, model serving infrastructure, and enterprise integration patterns. Write ADRs that become the team's engineering standards.
  • Serve as the first point of technical escalation for hard engineering decisions. Run design reviews, provide deep technical feedback on pull requests, and pair with engineers on the gnarliest problems.
  • Own the technical execution of major platform initiatives end to end-scoping, sequencing work, managing technical risk, and driving to production without losing quality.
  • Lead platform reliability strategy: define SLOs, shape the observability strategy, lead incident reviews, and continuously raise the bar on platform stability and operational maturity.
  • Lead technical design of governance and compliance controls-data residency, access management, audit logging, and AI usage policies-to satisfy enterprise customer requirements and compliance frameworks.
  • Drive cross-team alignment with AI engineering, product, and cloud engineering teams; communicate technical trade-offs clearly and represent platform capabilities to senior stakeholders.
  • Raise the technical craft of the team through thorough design reviews, documentation habits, and hands-on pairing-without managing anyone directly.


The Minimum Qualifications
  • 5+ years in platform, infrastructure, or SRE, with a track record as a technical lead or staff-level IC with team-wide technical scope.
  • Certified Kubernetes Administrator (CKA), Certified Kubernetes Application Developer (CKAD) or equivalent AWS Certifications.
  • 3+ years experience in cloud-native architecture: Kubernetes at scale, managed cloud services, networking, identity federation, and multi-tenancy patterns across AWS, GCP, or Azure.
  • 3+ years experience of proven ownership of complex, multi-month platform initiatives-driven from whiteboard to production, managing ambiguity and technical risk throughout.


The Ideal Qualifications
  • Strong IaC and GitOps fluency: Terraform or Pulumi, ArgoCD, with experience standardizing platform tooling and deployment patterns across engineering teams.
  • Hands-on experience with AI/ML infrastructure: model serving, inference pipelines, GPU resource management, or LLM integration patterns.
  • Experience mentoring engineers and influencing technical direction across teams.
  • Strong written communication: clear design docs, useful ADRs, and the ability to explain architectural decisions to both engineers and non-technical stakeholders.
  • LLM serving at scale-vLLM, Triton, Ray Serve-or experience with AI gateway design patterns.
  • Experience building an internal developer platform (IDP) from scratch, with a product mindset that obsesses over internal developer experience.
  • Strong grasp of AI safety, model evaluation, and governance frameworks.
  • Ability to lead through technical credibility-influencing design decisions, driving alignment, and raising quality without formal authority.
  • FinOps or GPU cost optimization experience across large inference workloads.
  • Open-source contributions to platform or ML infrastructure tooling.
  • Comfort with ambiguity: energized by undefined problem spaces, with a habit of building clarity and shared context where there isn't any.


What to Expect as Part of MassMutual and the Team
  • Regular meetings with the AI Platform Engineering team
  • Focused one-on-one meetings with your manager
  • Networking opportunities including access to Asian, Hispanic/Latinx, African American, women, LGBTQIA+, veteran and disability-focused Business Resource Groups
  • Access to learning content on Degreed and other informational platforms
  • Your ethics and integrity will be valued by a company with a strong and stable ethical business with industry leading pay and benefits


#LI-SC1

Salary Range:
$163,900-$215,000

At MassMutual, we focus on ensuring fair equitable pay, by providing competitive salaries, along with incentive and bonus opportunities for all employees. Your total compensation package includes either a bonus target or in a sales-focused role a Variable Incentive Compensation component.

About Massachusetts Mutual Life Insurance Company (MassMutual)

Massachusetts Mutual Life Insurance Company (MassMutual) Careers

Joining the team at Massachusetts Mutual Life Insurance Company (MassMutual) offers more than just a job; it opens the door to a world of job opportunities where professional growth and personal development are encouraged and nurtured. Massachusetts Mutual Life Insurance Company (MassMutual) stands as a beacon of innovation, leadership, and diversity in the insurance industry.

Explore Career Opportunities

Massachusetts Mutual Life Insurance Company (MassMutual) is actively hiring and offers a variety of positions that cater to different skills and career aspirations. From entry-level roles to leadership positions, the company seeks passionate, creative, and solution-driven team players. Explore the numerous job opportunities at Massachusetts Mutual Life Insurance Company (MassMutual) to find a position that matches your skills and interests.

Internship Programs

Kickstart your career with Massachusetts Mutual Life Insurance Company (MassMutual)'s internship programs. These opportunities provide invaluable industry experience, networking prospects, and a chance to work on real projects that impact the company and its clients. Internships at Massachusetts Mutual Life Insurance Company (MassMutual) are a stepping stone to full-time employment and offer a deep dive into the culture and operations of a leading insurance provider.

Employee Benefits and Culture

Massachusetts Mutual Life Insurance Company (MassMutual) is committed to supporting its team members not only in their professional lives but also in their personal growth. The company offers comprehensive benefits designed to nurture the well-being of its employees and their families. The culture at Massachusetts Mutual Life Insurance Company (MassMutual) is built on a foundation of respect, integrity, and diversity, fostering an environment where everyone can thrive.

Professional Development and Growth

Career growth at Massachusetts Mutual Life Insurance Company (MassMutual) is propelled by continuous learning and development opportunities. The company invests in diversity training, leadership programs, and innovation workshops to ensure that every team member has the resources to advance their career. Employees are encouraged to expand their knowledge base and acquire new skills through various training and development programs.

Networking and Innovation

At Massachusetts Mutual Life Insurance Company (MassMutual), networking and innovation go hand in hand. Employees are encouraged to connect with colleagues and industry professionals, enhancing their career prospects and contributing to the company's leadership in the market. The collaborative environment ensures that innovative ideas are shared and celebrated.

Join the Massachusetts Mutual Life Insurance Company (MassMutual) Team

Search open positions that align with your career goals at Massachusetts Mutual Life Insurance Company (MassMutual). Prepare your resume, hone your interview skills, and get ready to join a team that values leadership and professional growth. Discover how Massachusetts Mutual Life Insurance Company (MassMutual) can transform your career aspirations into reality.

Stay Connected with Massachusetts Mutual Life Insurance Company (MassMutual) Careers

Keep up to date with the latest news, career tips, and industry insights from Massachusetts Mutual Life Insurance Company (MassMutual). Subscribe to receive updates that can help you navigate your career path and make informed decisions about your professional future.

Explore Jobs and Careers at Massachusetts Mutual Life Insurance Company (MassMutual)

Whether you are seeking a new challenge, a leadership role, or a collaborative team environment, Massachusetts Mutual Life Insurance Company (MassMutual) offers a dynamic and supportive workspace for everyone. Check out the latest job openings and embark on a rewarding career journey with Massachusetts Mutual Life Insurance Company (MassMutual).
Learn more about Massachusetts Mutual Life Insurance Company (MassMutual)

Similar Jobs

More Jobs at Massachusetts Mutual Life Insurance Company (MassMutual)

More Information Technology Jobs

Find similar AI Platform Engineer jobs: