Machine Learning Operations Engineer

Mosai

$110K — $130K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's Degree in Computer Science, Engineering or equivalent work experience.
  • 5-7 years of experience in Data Engineering, MLOps, Machine Learning Engineering, or related areas.
  • Experience with both traditional ML models and LLM-based/MCP-orchestrated architectures.
  • Proficiency in Python, Jupyter, and standard ML/analytics frameworks.
  • Strong working knowledge of Azure and AWS cloud platforms, including best practices for security and orchestration.

Responsibilities

  • Design, build, and maintain robust data pipelines for model training and analytics.
  • Audit and refactor existing ML pipelines to reduce technical debt and streamline workflows.
  • Monitor production ML pipelines and troubleshoot performance issues or data anomalies.
  • Implement CI/CD workflows and model deployment strategies for reliable releases.
  • Collaborate with cross-functional teams to integrate machine learning models into production.
  • Maintain observability tools to ensure high system availability and traceability.
  • Document best practices and create runbooks for model operations.

Benefits

  • Collaboration with Data Science, Engineering, and Product teams on innovative projects.
  • Focus on auditing and enhancing existing processes for technical excellence.
  • Opportunity to work in a dynamic, fast-paced environment with a proactive culture.
  • Access to cloud infrastructure and the latest ML technologies.
Full Job Description
Position Summary

We are seeking an experienced Machine Learning Ops (MLOps) Engineer to architect, develop, and maintain the full lifecycle of data and model pipelines that power training, inference, evaluation, and analytics workflows. This role is responsible for ensuring the reliability, scalability, and observability of all machine learning systems in production, including traditional ML models and modern LLM-based/MCP-orchestrated architectures. A key focus of this role in the near term is auditing and consolidating our existing pipelines and deployment processes. The ideal candidate is highly skilled in Python, Jupyter, Snowflake, and both Azure and AWS cloud environments, and thrives in environments requiring continuous monitoring, rapid issue diagnosis, and rigorous validation before deployment.

Job Duties
  • Design, build, and maintain scalable data pipelines supporting model training, inference, batch processing, and real-time analytics workflows.
  • Audit, refactor, and consolidate existing ML pipelines and deployment processes to eliminate technical debt, redundant workflows, and undocumented manual steps.
  • Audit, refactor, and consolidate existing ML pipelines and deployment processes to eliminate technical debt, redundant workflows, and undocumented manual steps.
  • Monitor and deploy and deploy production ML pipelines to identify anomalies, performance degradations, or failures related to data quality, logic defects, or infrastructure issues.
  • Execute rapid troubleshooting and root-cause analysis followed by timely remediation, validation, and full regression testing prior to redeployment.
  • Collaborate with Data Science, Engineering, and Product teams to operationalize machine learning models-including LLM-based and MCP-orchestrated systems-ensuring seamless integration into production environments.
  • Develop CI/CD workflows, model deployment strategies, and automated testing frameworks to support reliable, repeatable releases.
  • Implement and maintain observability tooling (logging, monitoring, alerting) to ensure high availability and traceability of ML systems.
  • Manage and optimize cloud infrastructure across Azure and AWS for compute, storage, orchestration, and security needs.
  • Create and maintain documentation, runbooks, and best practices for model operations and system maintenance.
  • Perform all other job-related duties as assigned.


Minimum Requirements
  • Bachelor's Degree in Computer Science, Engineering or equivalent work experience.
  • 5-7 years of combined experience in Data Engineering, MLOps, Machine Learning Engineering, or related fields.
  • Demonstrated experience operationalizing traditional ML models as well as LLM-based and MCP-orchestrated systems.
  • Strong working knowledge of both Azure and AWS cloud platforms, including compute orchestration, networking, and security best practices.
  • Experience with CI/CD tools, containerization (Docker), infrastructure-as-code, and ML pipeline frameworks.
  • Strong ability to diagnose and resolve pipeline failures, data anomalies, and complex system issues.

Advanced proficiency in Python, Jupyter, and common ML/analytics frameworks.
  • Hands-on experience with Snowflake or similar cloud data warehousing enviro
  • Excellent problem-solving skills, attention to detail, and a proactive, self-directed work ethic.
  • Strong communication skills and comfort working in fast-paced, cross-functional environments.


Work Environment

  • This role is preferred to be based in Nashville or Jacksonville, near Mosai's offices.


Physical Demands of Our Work Environment
  • This position uses a computer and other office equipment as needed to perform duties. The in-office noise level in the work environment is typical of that of an office. Frequent interruptions may be encountered throughout the workday.
  • The employee is required to either stand or sit, talk and hear frequently required to use repetitive keying or hand motions.
  • The physical demands are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

Similar Jobs

More Jobs at Mosai

More Information Technology Jobs

Find similar Machine Learning Operations Engineer jobs: