H-E-B

Senior Manager-MLOps (Austin)

H-E-B • $150K — $180K *
Enterprise Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 7+ years of experience in software, data, or platform engineering
  • 2+ years of experience managing engineering teams
  • Hands-on experience with production ML frameworks (e.g., Vertex AI, Kubeflow)
  • Strong expertise in GCP and Infrastructure as Code (Terraform)
  • Solid background in container orchestration and distributed systems in Python
  • Practical understanding of distributed data processing (e.g., Spark, SQL)
  • Bachelor's or Master's degree in a relevant field

Responsibilities

  • Build, mentor, and lead a high-performing MLOps team
  • Architect and deliver a cohesive end-to-end MLOps platform
  • Establish engineering standards and drive process improvements
  • Partner with Data Scientists and ML Engineers to enhance developer experience
  • Establish high-throughput serving infrastructure for ML models
  • Leverage enterprise data platforms for efficient model governance and cost optimization

Benefits

  • Opportunities for career development and mentoring
  • Engagement in cutting-edge ML technology
  • Collaborative environment with cross-functional teams
  • Involvement in high-impact projects with enterprise-level scaling
  • Flexible working conditions including remote options
Full Job Description
Responsibilities

We are looking for an execution-driven Senior Engineering Manager – MLOps Platform to build and lead the engineering team powering H-E-B’s enterprise Machine Learning platform on Google Cloud Platform (GCP). You'll work closely with stakeholders from product and design, and other engineering leaders, to provide high-quality, repeatable technology delivery for the digital engineering organization. Responsible for managing a team(s) that may include multiple related departments. Partner with senior leaders to define engineering strategy, roadmap priorities, operational standards, and organizational objectives aligned with business goals. Responsible for resource allocation, prioritization, and financial responsibility. Responsible for hiring, firing, and performance / pay reviews.

Key Responsibilities & Essential Functions:

 

In this role, you will treat MLOps as a product, providing an end-to-end, self-service platform that empowers Data Scientists and ML Engineers to move models seamlessly from experimentation to production. You will bridge modern data platform foundations with scalable ML infrastructure, driving the vision for model training, CI/CD automation, scalable inference, LLMOps, and continuous monitoring.

  • People & Technical Leadership: Build, mentor, and lead a high-performing team of MLOps and platform engineers, including hiring, coaching, performance management, career development, and organizational planning.
  • End-to-End MLOps Platform: Architect and deliver a cohesive ML lifecycle platform—spanning feature stores, model registry, experimentation tracking, CI/CD for ML, andautomated pipelines.
  • Establish engineering standards, provide technical guidance on complex challenges, and drive improvements to processes, tools, and platform capabilities.
  • Developer Experience for AI/ML:Partner with Data Scientists and ML Engineers to improve developer experience through self-service tooling, SDKs, templates, and automated workflows.
  • Scalable Serving & LLMOps: Establish high-throughput batch and real-time inferenceinfrastructure on GCP, integrating LLMOps capabilities such as RAG pipelines, fine-tuninginfrastructure, and vector search.
  • Data Platform Integration & Governance: Leverage enterprise data platforms (BigQuery,data lakes) to ensure efficient data ingestion for training/serving, robust RBAC, modelgovernance, drift detection, and cost optimization.

The responsibilities and essential functions outlined above describe the general nature and level of work assigned to this position. This is not an exhaustive list of all duties, responsibilities, and skills required. Duties and responsibilities may be modified at any time based on business needs. Employees may be required to perform other job-related tasks as requested by their supervisor, subject to reasonable accommodations.Qualifications & Key Requirements:Work Experience:

  • 7+ years of experience in software, data, or platform engineering
  • 2+ years of experience managing engineering teams delivering production platform infrastructure.
  • Experience successfully delivering timely, high-quality software.

Knowledge/Skills/Abilities:

  • MLOps & AI Tooling:Hands-on experience with production ML frameworks and orchestrators (Vertex AI,Kubeflow, MLflow, Ray, Feast/Feature Stores, Triton, or vLLM).
  • GCP & Cloud Infrastructure:Strong expertise in GCP (Vertex AI, BigQuery, GKE, Cloud Composer/Airflow, Pub/Sub,Cloud Storage) and Infrastructure as Code (Terraform).
  • Engineering Practices:Solid background in container orchestration (Docker, Kubernetes), modern CI/CDautomation, and distributed systems in Python.
  • Data Platform Acumen:Practical understanding of distributed data processing (Spark, SQL) and how featurepipelines integrate into core data warehouses and data lakes.

 

  • Preferred QualificationsExperience migrating legacy ML workloads or scaling GenAI/LLM pipelines in an enterpriseretail, e-commerce, or supply chain environment.Familiarity with hybrid/multi-cloud data ecosystems (AWS, Databricks).Track record of building a strong "Platform-as-a-Product" culture with high internalcustomer adoption.

Education:

  • Bachelor's / Master's degree in a relevant field of education and / or work experience leading successful projects and coaching / mentoring others in functional area.

Physical Demands & Working Conditions:

  • Function in a fast-paced multi-priority environment
  • Travel by car or plane with overnight stays
  • Regularly lift up to 20 lbs
  • Work extended hours and / or rotating schedules

The work environment characteristics described here are representative of those a Partner encounters while performing the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.Last revised: 11/01/2024

JDENGINEERING

About H-E-B

H-E-B is a privately held supermarket chain based in San Antonio, Texas, with more than 340 stores throughout the U.S. state of Texas, as well as in northeast Mexico. The company also operates Central Market, an upscale organic and fine foods retailer. As of 2021, the company has a total revenue of $32 billion. H-E-B was named Retailer of the Year in 2010 by Progressive Grocer.
Learn more about H-E-B
Size
120,000 employees
Industry

Similar Jobs

More Jobs at H-E-B

More Enterprise Technology Jobs

Find similar Senior Manager-MLOps (Austin) jobs: