Machine Learning Operations Engineer

Mosai

$110K — $130K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science, Engineering, or equivalent experience.
  • 5-7 years in Data Engineering, MLOps, or Machine Learning Engineering.
  • Experience with traditional ML models and LLM-based systems.
  • Strong expertise in Azure and AWS platforms.
  • Proficient in CI/CD tools, Docker, and ML pipeline frameworks.

Responsibilities

  • Design and maintain scalable data pipelines for model training and inference.
  • Audit and streamline existing ML pipelines to reduce technical debt.
  • Monitor production ML pipelines and troubleshoot performance issues.
  • Implement CI/CD workflows and automated testing for deployments.
  • Collaborate with cross-functional teams to operationalize machine learning models.
  • Develop observability tools for monitoring ML systems.
  • Document processes and maintain best practices for model operations.

Benefits

  • Opportunity to work with cutting-edge machine learning technologies.
  • Collaborative work environment with cross-functional teams.
  • Access to continuous learning and professional development opportunities.
  • Flexible work schedule to promote work-life balance.
Full Job Description
Position Summary

We are seeking an experienced Machine Learning Ops (MLOps) Engineer to architect, develop, and maintain the full lifecycle of data and model pipelines that power training, inference, evaluation, and analytics workflows. This role is responsible for ensuring the reliability, scalability, and observability of all machine learning systems in production, including traditional ML models and modern LLM-based/MCP-orchestrated architectures. A key focus of this role in the near term is auditing and consolidating our existing pipelines and deployment processes. The ideal candidate is highly skilled in Python, Jupyter, Snowflake, and both Azure and AWS cloud environments, and thrives in environments requiring continuous monitoring, rapid issue diagnosis, and rigorous validation before deployment.

Job Duties
  • Design, build, and maintain scalable data pipelines supporting model training, inference, batch processing, and real-time analytics workflows.
  • Audit, refactor, and consolidate existing ML pipelines and deployment processes to eliminate technical debt, redundant workflows, and undocumented manual steps.
  • Audit, refactor, and consolidate existing ML pipelines and deployment processes to eliminate technical debt, redundant workflows, and undocumented manual steps.
  • Monitor and deploy and deploy production ML pipelines to identify anomalies, performance degradations, or failures related to data quality, logic defects, or infrastructure issues.
  • Execute rapid troubleshooting and root-cause analysis followed by timely remediation, validation, and full regression testing prior to redeployment.
  • Collaborate with Data Science, Engineering, and Product teams to operationalize machine learning models-including LLM-based and MCP-orchestrated systems-ensuring seamless integration into production environments.
  • Develop CI/CD workflows, model deployment strategies, and automated testing frameworks to support reliable, repeatable releases.
  • Implement and maintain observability tooling (logging, monitoring, alerting) to ensure high availability and traceability of ML systems.
  • Manage and optimize cloud infrastructure across Azure and AWS for compute, storage, orchestration, and security needs.
  • Create and maintain documentation, runbooks, and best practices for model operations and system maintenance.
  • Perform all other job-related duties as assigned.


Minimum Requirements
  • Bachelor's Degree in Computer Science, Engineering or equivalent work experience.
  • 5-7 years of combined experience in Data Engineering, MLOps, Machine Learning Engineering, or related fields.
  • Demonstrated experience operationalizing traditional ML models as well as LLM-based and MCP-orchestrated systems.
  • Strong working knowledge of both Azure and AWS cloud platforms, including compute orchestration, networking, and security best practices.
  • Experience with CI/CD tools, containerization (Docker), infrastructure-as-code, and ML pipeline frameworks.
  • Strong ability to diagnose and resolve pipeline failures, data anomalies, and complex system issues.


Advanced proficiency in Python, Jupyter, and common ML/analytics frameworks.
  • Hands-on experience with Snowflake or similar cloud data warehousing environment.
  • Excellent problem-solving skills, attention to detail, and a proactive, self-directed work ethic.
  • Strong communication skills and comfort working in fast-paced, cross-functional environments.


Work Environment

  • This role is preferred to be based in Nashville or Jacksonville, near Mosai's offices.


Physical Demands of Our Work Environment
  • This position uses a computer and other office equipment as needed to perform duties. The in-office noise level in the work environment is typical of that of an office. Frequent interruptions may be encountered throughout the workday.
  • The employee is required to either stand or sit, talk and hear frequently required to use repetitive keying or hand motions.
  • The physical demands are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.


Similar Jobs

More Jobs at Mosai

More Information Technology Jobs

Find similar Machine Learning Operations Engineer jobs: