Research Engineer - ML Infrastructure

Epsilon Health

$130K — $180K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience in building ML infrastructure, data pipelines, or ML systems for production.
  • Strong programming skills in Python, specifically with PyTorch or JAX.
  • Hands-on experience with data pipeline technologies like Spark, Airflow, and BigQuery.
  • Working knowledge of distributed systems and cloud environments (AWS/GCP) along with containerization tools (Docker/Kubernetes).
  • Demonstrated ability to construct scalable data systems and deliver production-ready ML solutions.
  • Strong adaptability to manage competing demands in a dynamic work setting.

Responsibilities

  • Build and optimize distributed ML infrastructure for large-scale medical imaging model training.
  • Design and implement data pipelines for processing multimodal medical imaging data.
  • Create centralized data storage systems using standardized formats for efficient data access.
  • Develop inference pipelines and evaluation frameworks for seamless research and production integration.
  • Collaborate with researchers to quickly prototype concepts into deployable code.
  • Oversee entire ML system lifecycle from experimentation to deployment and monitoring.

Benefits

  • Flexible working arrangements to optimize work-life balance.
  • Opportunities for professional development and continuous learning.
  • Collaborative culture focused on innovation and research.
  • Exposure to cutting-edge technologies in the healthcare space.
  • Comprehensive health and wellness benefits.
Full Job Description
Role Overview

We're seeking a research engineer to bridge the gap between research and production, building ML infrastructure and data systems for medical imaging at scale. You'll own critical data pipelines that unify live production traffic with offline datasets, design storage solutions for multimodal medical data, and build training + inference infrastructure that enables our research team to iterate rapidly. This role requires someone who can move fluidly between model training, data engineering, ML systems, and production deployment.

Key Responsibilities
  • Build and optimize distributed ML infrastructure for training foundation models on large-scale medical imaging datasets.
  • Design and implement robust data pipelines to collect, process, and store large-scale multimodal medical imaging data from both production traffic and offline sources.
  • Build centralized data storage solutions with standardized formats (e.g., protobufs) that enable efficient retrieval and training across the organization.
  • Create model inference pipelines and evaluation frameworks that work seamlessly across research experimentation and production deployment.
  • Collaborate with researchers to rapidly prototype new ideas and translate them into production-ready code.
  • Own end-to-end delivery of ML systems from experimentation through deployment and monitoring.


Qualifications
  • 5+ years building ML infrastructure, data pipelines, or ML systems in production
  • Strong Python skills and expertise in PyTorch or JAX
  • Hands-on experience with data pipeline technologies (e.g., Spark, Airflow, BigQuery, Snowflake, Databricks, Chalk) and schema design
  • Experience with distributed systems, cloud infrastructure (AWS/GCP), and containerization (Docker/Kubernetes)
  • Track record of building scalable data systems and shipping production ML infrastructure
  • Ability to move quickly and handle competing priorities in a fast-paced environment


Preferred Qualifications
  • Experience with reinforcement learning training pipelines (e.g., RLHF, reward modeling, or online learning systems)
  • Support A/B testing and experimentation workflows for model rollouts, including monitoring statistical significance and managing canary deployments.
  • Familiarity with vision-language models (VLMs) or multimodal architectures
  • Experience with medical imaging formats (DICOM) and healthcare data standards
  • Background in distributed training frameworks (PyTorch Lightning, DeepSpeed, Accelerate)
  • Familiarity with MLOps practices and model deployment pipelines
  • Experience with privacy-preserving data systems and HIPAA compliance

Similar Jobs

More Jobs at Epsilon Health

More Information Technology Jobs

Find similar Research Engineer - ML Infrastructure jobs: