Senior MLOps & AI Infrastructure Engineer

Altera Corporation

$149K — $215K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's or Master's degree in Computer Science, Machine Learning, Statistics, or related field and 10+ years of industry experience
  • 10+ years of experience in ML engineering, data science, and MLOps with production model deployment
  • 8+ years of experience with parallelism strategies (FSDP, DeepSpeed, data/model parallelism)
  • 10+ years of experience and proficiency in Python programming
  • 8+ years of experience in cloud ML platforms (AWS, GCP, Azure), Docker/Kubernetes, and CI/CD pipelines
  • 5+ years of hands-on experience with MLflow, W&B, or Neptune for tracking and reproducibility

Responsibilities

  • Design, build, and maintain scalable ML pipelines for cloud and HPC
  • Build MLOps infrastructure including experiment tracking and model registry
  • Implement CI/CD/CT pipelines for ML models using tools such as Kubeflow or MLflow
  • Containerize ML workflows with Docker and orchestrate using Kubernetes
  • Develop and deploy large-scale models including LLMs and GNNs for EDA applications
  • Apply advanced techniques like transfer learning and model optimization
  • Build and maintain large-scale data pipelines and feature management systems

Benefits

  • Collaborative work environment with cross-functional teams
  • Opportunity to mentor junior engineers and lead best practices
  • Involvement in cutting-edge AI/ML solutions for semiconductor and EDA
  • Access to advanced tools and cloud platforms
  • Focus on automating and optimizing AI infrastructure
Full Job Description
Job Details:

Job Description:

About the Role

We are looking for a Senior MLOps & AI Infrastructure Engineer to architect, build, and operationalize machine learning systems at scale. This role sits at the intersection of data science, software engineering, and infrastructure - combining deep ML expertise with the DevOps/MLOps discipline required to ship models reliably into production.

You will partner closely with software, data, and infrastructure teams to design end-to-end ML pipelines, automate model lifecycle management, and deliver AI-powered capabilities across our EDA, HPC, and cloud environments.

Key Responsibilities:

ML Platform & Pipeline Engineering
• Design, build, and maintain scalable ML pipelines for training, evaluation, and deployment across cloud and on-prem HPC environments
• Build MLOps infrastructure including experiment tracking, model registry, feature stores, and automated retraining workflows
• Implement CI/CD/CT (Continuous Training) pipelines for ML models using tools such as Kubeflow, MLflow, Airflow, or similar
• Containerize ML workloads with Docker and orchestrate at scale using Kubernetes and GPU node pools

Model Development & Optimization
• Develop, fine-tune, and deploy large-scale models including LLMs, GNNs, and reinforcement learning agents for EDA and chip design applications
• Apply advanced techniques: transfer learning, quantization, pruning, distillation, and RLHF for production-grade model efficiency
• Implement A/B testing frameworks and shadow deployments for safe model rollout
• Benchmark and optimize model inference performance on GPU/TPU clusters

Data Engineering & Feature Management
• Build and maintain data pipelines for large-scale structured and unstructured datasets (terabyte-scale)
• Collaborate with data teams to design feature engineering systems and maintain data quality for ML training
• Implement data versioning and lineage tracking (DVC, Delta Lake, or similar)

Infrastructure & Operations
• Manage cloud ML infrastructure on AWS (SageMaker), Azure (AML), or GCP (Vertex AI) with cost and performance optimization
• Automate infrastructure provisioning using Terraform or CloudFormation for GPU-backed ML environments
• Build monitoring, alerting, and observability systems for model performance drift, data quality, and system health
• Support HPC schedulers (LSF, Slurm) for large-scale distributed training jobs

Collaboration & Leadership
• Partner with research scientists to productionize experimental models with engineering rigor
• Mentor junior engineers and define ML engineering best practices across the organization
• Drive adoption of AI/ML solutions within semiconductor, EDA, and simulation workflows

Technology Stack

ML Frameworks:

PyTorch • TensorFlow • JAX • Hugging Face • scikit-learn • XGBoost

MLOps & Pipelines:

MLflow • Kubeflow • Airflow • Weights & Biases • DVC • Feast

Infrastructure & Cloud:

AWS SageMaker / GCP Vertex AI / Azure ML • Terraform • Docker • Kubernetes • Slurm / LSF

Languages:

Python • Bash • Go • SQL

Monitoring & Observability:

Prometheus • Grafana • ELK Stack • Evidently AI • Arize

Key Competencies
• Strong ownership mindset - you drive ML initiatives from prototype to production without being asked
• Bias toward automation: if you do it twice, you automate it
• Ability to bridge research and engineering - translating papers into production-grade systems
• Thrives in fast-paced, ambiguous environments typical of deep-tech and semiconductor companies
• Clear communicator who can explain complex ML concepts to non-technical stakeholders

Salary Range

The pay range below is for Bay Area California only. Actual salary may vary based on a number of factors including job location, job-related knowledge, skills, experiences, trainings, etc. We also offer incentive opportunities that reward employees based on individual and company performance.

$149,100 - $215,925 USD

We use artificial intelligence to screen, assess, or select applicants for the position. Applicants must be eligible for any required U.S. export authorizations.

Qualifications:

Required Qualifications
  • Bachelor's or Master's degree in Computer Science, Machine Learning, Statistics, or related field and 10+ years of industry experience
  • 10+ years of experience across ML engineering, data science, and MLOps - including frameworks (PyTorch, TensorFlow, JAX, Hugging Face) and production model deployment at scale
  • 8+ years of experience experience with parallelism strategies (FSDP, DeepSpeed, data/model parallelism)
  • 10+ years of experience and proficiency in Python programming
  • 8+ years of experience in cloud ML platforms (AWS, GCP, Azure), Docker/Kubernetes, and CI/CD pipelines
  • 5+ years of hands-on experience with MLflow, W&B, or Neptune for tracking and reproducibility


Preferred Qualifications
  • Phdin Computer Science, Machine Learning, Statistics, or related field
  • Experience applying ML/AI to semiconductor, EDA, or chip design domains (e.g., timing prediction, place & route optimization, DRC closure)
  • Familiarity with HPC schedulers such as LSF or Slurm and GPU cluster management for training workloads
  • Knowledge of LLM fine-tuning, Retrieval-Augmented Generation (RAG) architectures, and AI agent frameworks such as LangChain or AutoGen
  • Experience with graph neural networks (GNNs) or geometric deep learning for circuit and netlist analysis
  • Background in reinforcement learning for optimization problems
  • Exposure to zero-trust security, DevSecOps, and compliance automation for ML systems
  • Experience working with large-scale simulation pipelines and synthetic data generation
  • Experience at organizations such as NVIDIA, AMD, Intel, Google DeepMind, or similar AI/HPC-focused companies
  • Published research or open-source contributions in ML, MLOps, or AI for EDA
  • Experience building AI-powered developer tools or copilot-style products
  • Familiarity with Synopsys, Cadence, or Siemens EDA toolchains and associated data formats


Job Type:
Regular

Shift:
Shift 1 (United States of America)

Primary Location:
San Jose, California, United States

Additional Locations:

Similar Jobs

More Jobs at Altera Corporation

More Information Technology Jobs

Find similar Senior MLOps & AI Infrastructure Engineer jobs: