Eli Lilly

ML Ops Engineer

Eli Lilly$147K — $268K *
Pharmaceuticals & Biotech
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science, Engineering, Statistics, Mathematics, or a related field.
  • 4+ years of experience in machine learning engineering, ML Ops, or platform engineering.
  • Strong Python skills with expertise in machine learning frameworks like PyTorch, JAX, or TensorFlow.
  • Experience deploying and scaling production machine learning platforms.
  • Proficiency in containerization and orchestration tools such as Docker and Kubernetes.
  • Familiarity with cloud platforms like AWS, Azure, or GCP.

Responsibilities

  • Lead the operational lifecycle of ML models through deployment and monitoring.
  • Operate large-scale inference platforms for scientific and AI workloads.
  • Ensure reliable deployment and scalability of models in production environments.
  • Test and enhance model accuracy continually.
  • Collaborate with data scientists and business analysts on broader ML strategies.
  • Automate platforms using infrastructure-as-code and document processes for usability.

Benefits

  • Flexible hybrid work model with three days onsite and two remote days weekly.
  • Access to employee resource groups supporting diverse communities within the company.
  • Comprehensive benefits program including medical, dental, and vision insurance.
  • Eligibility for a company-sponsored 401(k) and pension plan.
  • Well-being benefits including fitness programs and employee assistance programs.
Full Job Description
Where AI Meets Medicine: Build the Future of Drug Discovery in the Heart of Silicon Valley!

Making medicine that's never been made means doing what's never been done. If you're an engineer, scientist, or builder who thrives on problems no one has solved before, this is your invitation; we want you on the team. We are ready to challenge the status quo and push medicine forward, all in the name of health. Are you up for the challenge? If so, join us!

About the Lilly and NVIDIA Partnership

Lilly and NVIDIA are launching a new AI co-innovation lab in the heart of Silicon Valley - an up-to-$1 billion, multi-year commitment to solve drug discovery's toughest challenges. The lab brings Lilly scientists, technologists, chemists and biologists together with NVIDIA engineers under one roof. Together, we are building purpose-built foundation and frontier AI models trained on Lilly data at scale, tightening the feedback loop between automated wet labs and computational dry labs, designing the next generation of medicines for millions of patients across the globe.

What You'll Be Doing

As an ML Ops Engineer, you build and operate the platforms that run the end-to-end machine learning lifecycle. You enable reliable model deployment, operation, monitoring, retraining, and reproducibility at scale. You optimize infrastructure and GPU resources to support research and discovery workloads. You will work closely with engineering and scientific teams to deliver production-ready AI capabilities.

How You'll Succeed

  • Lead the operational lifecycle of ML models, including deployment, monitoring, and ongoing reliability.
  • Operate and optimize large-scale inference platforms that support scientific discovery and AI workloads.
  • Ensure models can be deployed, scaled, monitored, and maintained in production environments.
  • Test, refine, and improve model accuracy.
  • Work with data scientists, business analysts and partners to integrate ML models into broader strategies.
  • Automate the platform with infrastructure-as-code and CI/CD, and document it well enough that someone else can operate it.


What You Should Bring

  • Strong Python skills and experience working with machine learning frameworks such as PyTorch, JAX, or TensorFlow.
  • Experience deploying, operating, and scaling production machine learning platforms, including model serving, monitoring, and large-scale inference workloads.
  • Experience with MLOps platforms and tools like MLflow, Weights & Biases, KServe, or similar technologies.
  • Proficiency with containerization, orchestration, and distributed compute environments (Docker, Kubernetes, Slurm, Ray).
  • Experience operating large-scale AI platforms that deploy, host, and optimize machine learning models for production use, using technologies such as Triton, vLLM, or TensorRT-LLM.
  • Experience with infrastructure automation and CI/CD practices using tools such as Terraform, Ansible, GitHub Actions, or related.
  • Experience supporting cloud platforms (AWS, Azure, or GCP) and on-premises GPU infrastructure.
  • Knowledge of observability and operational monitoring, including metrics, logging, tracing, and performance tuning.
  • Ability to identify and address system, infrastructure, and model performance issues through automation and continuous improvement.
  • Ability to collaborate effectively with research scientists, AI engineers, and infrastructure teams in a fast-paced environment.


Your Basic Qualifications

  • Bachelor's in Computer Science, Engineering, Statistics, Mathematics, or a related technical field
  • 4+ years of experience in machine learning engineering, ML Ops, or platform engineering.


Location & Work Flexibility
This role is based at our Silicon Valley Hub. We offer a flexible hybrid work model, with three days onsite and two days working remotely each week, supporting both collaboration and work-life balance.

Our employee resource groups (ERGs) offer strong support networks for their members and are open to all employees. Our current groups include: Africa, Middle East, Central Asia (AMECA), Black Employees at Lilly (BE[redacted]), Chinese Culture Network (CCN), EnAble, Evolve, Lilly Indian Network (LIN), Organization of Latinx at Lilly (OLA), Pride (LGBTQ+ Allies), Veterans Leadership Network (VLN) and Women's Initiative for Leading at Lilly (WILL).

Actual compensation will depend on a candidate's education, experience, skills, and geographic location. The anticipated wage for this position is
$147,000 - $268,400

Full-time equivalent employees also will be eligible for a company bonus (depending, in part, on company and individual performance). In addition, Lilly offers a comprehensive benefit program to eligible employees, including eligibility to participate in a company-sponsored 401(k); pension; vacation benefits; eligibility for medical, dental, vision and prescription drug benefits; flexible benefits (e.g., healthcare and/or dependent day care flexible spending accounts); life insurance and death benefits; certain time off and leave of absence benefits; and well-being benefits (e.g., employee assistance program, fitness benefits, and employee clubs and activities).Lilly reserves the right to amend, modify, or terminate its compensation and benefit programs in its sole discretion and Lilly's compensation practices and guidelines will apply regarding the details of any promotion or transfer of Lilly employees.

About Eli Lilly

ICOS Corporation is a biotechnology company that engages in the discovery, development, and commercialization of therapeutic products. It is engaged in the commercialization of treatments for unmet medical conditions, such as benign prostatic hyperplasia, hypertension, pulmonary arterial hypertension, cancer, and inflammatory diseases. It is the developer of a treatment known as Cialis (tadalafil), a product for the treatment of erectile dysfunction through its joint venture with Eli Lilly and Company in North America and Europe. It is also engaged in contract manufacturing services for third parties. It is in a strategic alliance with Solvay Pharmaceuticals, Inc. ICOS Corporation was established in 1989, based in Bothell, Washington. It is currently operated by Eli Lilly and Company.

Eli Lilly Careers

Joining Eli Lilly offers an unparalleled opportunity to become part of a leading global team dedicated to creating a healthier future. As a company revered for its commitment to innovation and leadership in the pharmaceutical industry, Eli Lilly is where your professional journey can flourish. Work You’ll Do At Eli Lilly, we are passionate about transforming patient care and advancing medical innovation. Our team at Eli Lilly is at the forefront of developing groundbreaking solutions in healthcare. By joining us, you will collaborate with some of the brightest minds in the industry, using cutting-edge technology to make real-world impacts. Lead with Innovation and Leadership Eli Lilly stands out in the marketplace by integrating deep industry expertise with robust research and development efforts. We are looking for professionals who are eager to drive change and lead the way in developing therapeutic breakthroughs. Explore Job Opportunities and Growth Eli Lilly offers a variety of career paths, including full-time positions and internships, across multiple functions such as research, marketing, IT, and sales. Whether you are a seasoned professional or a recent graduate, Eli Lilly provides an environment that promotes career growth and learning opportunities. Our commitment to diversity and leadership training ensures that every employee can achieve their potential. Be Part of Our Team Our team at Eli Lilly is committed to excellence and driven by a mission to improve lives. Employees enjoy a supportive culture that values collaboration, creativity, and diversity. We believe that a diverse workforce fosters innovation and helps us better connect with the communities we serve. Benefits and Culture Eli Lilly is dedicated to supporting our employees, offering competitive benefits, wellness programs, and comprehensive health care. Our culture is built on a foundation of respect, integrity, and quality, making Eli Lilly not just a great place to work, but a community to grow with. Networking and Professional Development Eli Lilly encourages continuous professional development and networking. With access to various training programs and mentorship opportunities, employees can enhance their skills and advance their careers. Our leadership is committed to nurturing talent through effective training and development strategies. Join Our Team Discover the exciting job opportunities at Eli Lilly by exploring open positions that match your skills and interests. We are continuously hiring and looking for individuals who are passionate, innovative, and ready to contribute to our mission of making life better for people around the globe. Stay Connected Keep up to date with the latest at Eli Lilly by following our careers blog. Gain insights from industry leaders and get tips on everything from crafting the perfect resume to preparing for your interview. Eli Lilly is not just a company—it's a place where you can make a difference. Explore the positions available and find out how your talents can help change the world. SEARCH ELI LILLY JOBS Stay ahead in your career with Eli Lilly, where innovation, leadership, and a commitment to diversity and growth lead the way to future advancements.
Learn more about Eli Lilly
Size
35,000 employees
Market Cap
$344.2 billion
Industry
Net Income
$6.1 billion
Founded
1876
5 Year Trend
+5.9%
Revenue
$24.5 billion
NASDAQ

Similar Jobs

More Jobs at Eli Lilly

More Pharmaceuticals & Biotech Jobs

Find similar ML Ops Engineer jobs: