AI Platform Engineer

Ova Technologies

$120K — $150K *
Enterprise Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or related field.
  • 4+ years in Platform Engineering, DevOps, MLOps, or Cloud Engineering.
  • Strong programming skills in Python.
  • Experience with Docker and Kubernetes.
  • Hands-on experience with AWS, Azure, or Google Cloud Platform.
  • Experience building CI/CD pipelines using GitHub Actions, GitLab CI, or Jenkins.
  • Knowledge of Linux systems and networking.

Responsibilities

  • Design, develop, and maintain AI/ML platforms and infrastructure.
  • Build scalable MLOps pipelines for model training and deployment.
  • Develop CI/CD workflows for machine learning applications.
  • Manage Kubernetes clusters and containerized AI workloads.
  • Implement model serving and feature stores, along with experiment tracking solutions.
  • Integrate Large Language Models (LLMs) and AI frameworks into enterprise platforms.
  • Monitor platform performance, reliability, scalability, and security.

Benefits

  • Hybrid/remote/on-site work options.
  • Opportunity to collaborate with a diverse range of professionals in AI/ML and DevOps.
  • Continuous learning and professional development opportunities.
  • Access to cutting-edge AI technologies and tools.
Full Job Description
Job Title: AI Platform Engineer

Job Summary

We are looking for an AI Platform Engineer to design, build, and maintain scalable AI infrastructure and platforms that enable data scientists and machine learning engineers to develop, deploy, monitor, and manage AI/ML models efficiently. The ideal candidate has strong experience with cloud platforms, MLOps, containerization, automation, and modern AI technologies.

Key Responsibilities
  • Design, develop, and maintain AI/ML platforms and infrastructure.
  • Build scalable MLOps pipelines for model training, deployment, monitoring, and retraining.
  • Develop CI/CD workflows for machine learning applications.
  • Manage Kubernetes clusters and containerized AI workloads.
  • Implement model serving, feature stores, model registries, and experiment tracking solutions.
  • Optimize GPU infrastructure and distributed training environments.
  • Integrate Large Language Models (LLMs), vector databases, and AI frameworks into enterprise platforms.
  • Monitor platform performance, reliability, scalability, and security.
  • Collaborate with Data Scientists, ML Engineers, Data Engineers, and DevOps teams.
  • Implement Infrastructure as Code (IaC) using tools such as Terraform.
  • Ensure platform governance, compliance, and cost optimization.
  • Troubleshoot production AI platform issues and improve operational efficiency.

Required Qualifications
  • Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field.
  • 4+ years of experience in Platform Engineering, DevOps, MLOps, or Cloud Engineering.
  • Strong programming skills in Python.
  • Experience with Docker and Kubernetes.
  • Hands-on experience with AWS, Azure, or Google Cloud Platform.
  • Experience building CI/CD pipelines using GitHub Actions, GitLab CI, or Jenkins.
  • Experience with Terraform or similar Infrastructure as Code tools.
  • Knowledge of Linux systems and networking.
  • Experience with monitoring tools such as Prometheus and Grafana.
  • Familiarity with distributed systems and scalable architectures.

Preferred Qualifications
  • Experience with ML platforms such as MLflow, Kubeflow, SageMaker, Vertex AI, or Azure ML.
  • Experience deploying and managing Large Language Models (LLMs).
  • Knowledge of vector databases such as Pinecone, Milvus, Weaviate, or Chroma.
  • Experience with LangChain, LangGraph, LlamaIndex, or similar AI orchestration frameworks.
  • Experience with distributed training frameworks and GPU optimization.
  • Knowledge of Apache Airflow, Kafka, Spark, or Ray.
  • Familiarity with security best practices for AI infrastructure.

Technical Skills
  • Python
  • Docker
  • Kubernetes
  • Terraform
  • Git
  • CI/CD
  • AWS / Azure / GCP
  • MLflow
  • Kubeflow
  • SageMaker / Vertex AI / Azure ML
  • LangChain
  • LlamaIndex
  • Vector Databases
  • Linux
  • Prometheus
  • Grafana
  • PostgreSQL
  • Redis

Soft Skills
  • Strong problem-solving and analytical skills
  • Excellent communication and collaboration
  • Ownership and accountability
  • Ability to work in Agile environments
  • Continuous learning mindset

Nice to Have
  • Experience with Generative AI applications
  • Experience with Retrieval-Augmented Generation (RAG)
  • Knowledge of AI governance and Responsible AI practices
  • AI platform cost optimization experience
  • Relevant cloud or Kubernetes certifications

Location

Hybrid / Remote / On-site (as applicable)

Employment Type

Full-time

Similar Jobs

More Jobs at Ova Technologies

  • AI Platform Engineer
    $120K — $150K *
    New York, NY 10025 (New York County)
    Enterprise Technology
    In-Person
  • AI Platform Engineer
    $120K — $150K *
    Remote
    Enterprise Technology
    Remote in New York, NY
  • AI Monitoring Engineer
    $120K — $150K *
    New York, NY 10025 (New York County)
    Information Technology
    In-Person
  • Applied AI Scientist
    $120K — $160K *
    New York, NY 10025 (New York County)
    Enterprise Technology
    In-Person
  • Quantitative AI Analyst
    $90K — $130K *
    New York, NY 10025 (New York County)
    Finance & Insurance
    In-Person

More Enterprise Technology Jobs

Find similar AI Platform Engineer jobs: