ML Infrastructure Engineer

Graphon.AI

$180K — $250K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's, Master's, or PhD in Computer Science, Machine Learning, Robotics, or related field (or equivalent experience)
  • Strong software engineering skills with a focus on Python; C++/Go experience is a plus
  • Experience with machine learning infrastructure including training and serving systems
  • Familiarity with ML stacks like PyTorch/JAX and distributed training
  • Solid systems understanding: version control, Linux, networking, CI/CD
  • Proactive problem-solver with ownership mentality
  • Collaborative and pragmatic approach to tool selection and execution

Responsibilities

  • Develop and maintain production-level machine learning systems
  • Build and optimize training and inference pipelines
  • Implement and manage data pipelines for model deployment
  • Drive the adoption of modern ML tools and technologies
  • Ensure robust version control and CI/CD practices in the development process
  • Collaborate with cross-functional teams for rapid iteration and solution development

Benefits

  • Meaningful equity stake in a high-potential company
  • Comprehensive health, dental, and vision benefits
  • Competitive paid time off policies
Full Job Description
About You Required • Bachelor's, Master's, or PhD in Computer Science, Machine Learning, Robotics, or a related technical field (or equivalent practical experience). • Strong software engineering fundamentals with experience building production systems (Python required; experience with C++/Go a plus). • Experience working with machine learning infrastructure, such as training pipelines, inference/serving systems, data pipelines, or model deployment. • Familiarity with modern ML stacks (e.g., PyTorch/JAX, GPUs, distributed training or inference). • Solid understanding of core systems concepts (version control, Linux, basic networking, CI/CD). • High agency and ownership mindset-you identify problems, propose solutions, and drive execution. • Pragmatic, "right tool for the job" thinker who enjoys collaborating and iterating quickly. Nice to Have • Experience scaling ML systems in production environments. • Experience with distributed systems, large-scale data processing, or GPU optimization. • Exposure to multimodal ML, retrieval systems, or graph-based representations. • Prior startup experience or comfort operating in ambiguous, fast-moving environments. Compensation & Benefits • Base salary range: $180,000 - $250,000 (depending on experience and level) • Meaningful equity with the opportunity to own a real stake in a category-defining company • Comprehensive benefits, including health, dental, vision, and competitive paid time off

Similar Jobs

More Jobs at Graphon.AI

  • Founding Marketer
    $180K — $230K *
    San Francisco, CA 94112 (San Francisco County)
    Consumer Technology
    In-Person
  • Site Reliability/Devops Engineer
    $100K — $200K *
    San Francisco, CA 94112 (San Francisco County)
    Information Technology
    In-Person
  • Full Stack Engineer
    $180K — $250K *
    San Francisco, CA 94112 (San Francisco County)
    Enterprise Technology
    In-Person
  • Research Engineer
    $180K — $250K *
    San Francisco, CA 94112 (San Francisco County)
    Information Technology
    In-Person

More Information Technology Jobs

Find similar ML Infrastructure Engineer jobs: