Machine Learning Engineer Lead

Compunnel

$150K — $180K *
Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 10+ years of experience in production-grade machine learning systems.
  • Strong experience with LLMs and Generative AI in production settings.
  • Solid Python development skills.
  • Cloud expertise with AWS, Azure, or GCP.
  • Hands-on experience with Kubernetes and containerization.
  • Experience in designing agentic AI systems and orchestration frameworks.
  • Proven technical leadership and mentorship capabilities.

Responsibilities

  • Define reference architectures for LLM and agent-based systems.
  • Design high-availability and low-latency inference platforms at global scale.
  • Establish reusable components for model lifecycle management and deployment.
  • Architect scalable AI platforms for enterprise AI workloads.
  • Lead governance of Model Context Protocol servers for tool integration.
  • Define guardrails and security controls for enterprise AI systems.
  • Collaborate with teams to align with enterprise AI platform strategy.

Benefits

  • Mentorship opportunities for professional development.
  • Work in a cutting-edge AI/ML environment with a global impact.
  • Engagement in shaping long-term AI platform strategies.
  • Possibility to lead and influence technical standards across teams.
Full Job Description
Job Summary
The Machine Learning Engineer Lead will define and lead the architecture of scalable AI/ML and agentic systems across the global product portfolio. This senior technical leadership role will focus on large-scale distributed ML systems, LLM and RAG architectures, Agentic AI frameworks, tool orchestration, and enterprise platform engineering. The role will shape long-term AI platform strategy, establish technical standards, and mentor engineering teams while supporting highly available, secure, and scalable AI systems.

Key Responsibilities
• Define reference architectures for LLM, machine learning, and agent-based systems across products.
• Design high-availability and low-latency inference platforms capable of operating at global scale.
• Establish reusable platform components for model lifecycle management, deployment, monitoring, and operationalization.
• Architect scalable AI platforms supporting large-scale distributed ML systems and enterprise AI workloads.
• Architect multi-step, reasoning-driven agentic AI systems.
• Design orchestration patterns for tool use, API invocation, and structured function calling.
• Lead the implementation and governance of Model Context Protocol (MCP) servers to standardize tool integration and context management.
• Define guardrails, permissions, security controls, and audit mechanisms for enterprise-safe AI systems.
• Establish and maintain best practices for MLOps, CI/CD, observability, scalability, and system reliability.
• Design and implement scalable inference systems using containerization and Kubernetes.
• Drive the deployment and optimization of LLM, Generative AI, and RAG solutions in production environments.
• Design cloud-based AI/ML architectures across AWS, Azure, or GCP.
• Establish technical standards and architectural patterns for AI/ML and agentic systems across engineering teams.
• Embed Responsible AI principles into platform architecture and engineering practices.
• Provide technical leadership, mentorship, and guidance to senior engineers and engineering teams.
• Collaborate with cross-functional teams to influence technical direction and ensure alignment with enterprise AI platform strategy.
• Support people management, leadership, and team development activities as required.

Required Qualifications
• 10+ years of experience building and deploying production-grade machine learning systems at scale.
• Strong experience with LLMs, Generative AI, and RAG deployments in production environments.
• Strong Python development background.
• Expertise designing and implementing AI/ML systems in cloud environments such as AWS, Azure, or GCP.
• Hands-on experience with Kubernetes, containerization, and scalable inference systems.
• Experience designing agentic AI systems and tool orchestration frameworks.
• Experience implementing and governing MCP servers or structured architectures for tool integration and context management.
• Experience with large-scale distributed ML systems and enterprise platform engineering.
• Experience establishing MLOps, CI/CD, observability, and system reliability practices.
• Demonstrated people management, technical leadership, or mentorship experience.
• Strong understanding of high-availability and low-latency AI/ML architectures.
• Ability to define technical standards and influence architecture and engineering decisions across teams.

Similar Jobs

More Jobs at Compunnel

More Enterprise Technology Jobs

Find similar Machine Learning Engineer Lead jobs: