Machinify

Sr. Director | Engineering, ML

Machinify$150K — $200K *
US-AnywhereRemote in United States
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • BS or MS in Computer Science (or equivalent experience).
  • 5+ years managing teams of ~8+ engineers with hands-on technical leadership.
  • 8+ years direct technical contribution in backend services.
  • 3+ years specifically building AI/ML production-grade services at scale.
  • Strong in Java, Scala, Rust, or similar backend languages, plus Python.
  • Understanding of productizing ML/AI platforms - workflows, serving, observability, reliability, and scale.
  • Fluent in data science concepts to collaborate with DS leadership.

Responsibilities

  • Lead and grow the AI/ML Engineering team while coordinating with data scientists on projects.
  • Design, deliver, and operate the core AI/ML platform including several advanced architecture components.
  • Run AI/ML systems at scale ensuring reliability, observability, and performance.
  • Create processes for transitioning proof-of-concept code from Data Science to production-grade services.
  • Partner with Chief AI Officer and Product Manager to guide product strategy amid ambiguity.
  • Facilitate streamlined stand-ups across engineering and data science, focusing on capacity planning.
  • Lead cross-functional team in leveraging AI technologies for coding excellence and incident management.

Benefits

  • Work from anywhere in the US!
  • Top Medical/Dental/Vision offerings
  • FSA/HSA
  • Tuition reimbursement
  • Competitive salary and 401(k) with company match
  • Unlimited PTO
  • Additional health and wellness benefits and perks
  • Flexible and empowering work environment
Full Job Description
Were seeking a hands-on, technically deep Sr/Director of Engineering to lead our ML Engineering team! You will manage and grow a team of engineers who build and own the core AI/ML platform for the company, and running it at massive scale. You will also serve as a key thought partner to our Chief AI Officer, bridging the gap between data science proof-of-concepts and scalable, production-grade services.

The ideal candidate blends AI/ML engineering depth with applied data science fluency. You understand what it takes to productize AI/ML capabilities - serving, observability, reliability, and scale - and youre fluent enough in data science concepts to anticipate platform needs and influence upstream design decisions. You have opinions on LLM and agent architecture, not just executing someone elses roadmap. Youre structured in managing deliverables across engineering and data science, surface ambiguities early, and drive down production incidents with a culture of efficient response.

Does this sound like the right opportunity to explore?... Lets connect!

(What youll do) Responsibilities/Impact:
  • Lead and grow the AI/ML Engineering team, while coordinating execution across contributors including data scientists on collaborative projects.
  • Design, deliver and operate the core AI/ML platform: agent frameworks, evaluation harnesses, labeling systems, document processing systems, semantic search, knowledge bases, model hosting, and more.
  • Run AI/ML systems at scale in production with reliability, observability, performance, and incident response. Build a culture of operational excellence.
  • Create processes to ensure proof-of-concept code from Data Science can be designed as production-grade services.
  • Partner with the Chief AI Officer and Product Manager to build forward-looking product strategy. Drive structured thinking in ambiguity.
  • Run tight, streamlined stand-ups across engineering and data science. Do capacity planning for driving predictability and velocity around delivery.
  • Provide leadership in ensuring the cross-functional team can utilize AI technologies to accelerate team excellence in coding, PR reviews, testing, observability and incident response. Keep up with the latest developments in LLM/agent advances and modern AI/ML infrastructure.

(What youll bring) Required Skills/Qualifications:
  • BS or MS in Computer Science (or equivalent experience).
  • 5+ years managing teams of ~8+ engineers with hands-on technical leadership.
  • 8+ years direct hands on technical contributor in backend services experience.
  • 3+ years specifically building AI/ML production-grade services at scale for multiple use cases. Direct co-working with data science and engineering.
  • Strong in Java, Scala, Rust, or similar backend languages, plus Python.
  • Understanding of what it takes to productize ML/AI platforms - workflows, serving, observability, reliability, and scale.
  • Fluent enough in data science concepts to be a real partner to DS leadership.
  • Strong communicator, organized, and proactive.
  • Comfortable with ambiguity and taking the initiative.

Nice to Have:
  • Healthcare domain experience.

What We Offer
  • Work from anywhere in the US! Machinify is digital-first.
  • Top Medical/Dental/Vision offerings
  • FSA/HSA
  • Tuition reimbursement
  • Competitive salary, 401(k) with company match
  • Unlimited PTO
  • Additional health and wellness benefits and perks
  • Flexible and trusting environment where youll feel empowered to do your best work

The salary for this position is based on an array of factors unique to each candidate: Such as years and depth of experience, set skills, certifications, etc. We are hiring for different levels and the base salary can vary based on your assessed level. Compensation also includes meaningful equity, healthcare, unlimited PTO, and more.

About Machinify

Machinify is a software and technology services company that provides a platform for businesses to automate their workflows. The company's platform uses artificial intelligence and machine learning to help businesses streamline their operations and improve efficiency. Machinify's software can be used in a variety of industries, including finance, healthcare, and retail. The company was founded in 2017 and is headquartered in New York City.
Learn more about Machinify
Size
10 employees
Industry
Founded
2017

Similar Jobs

More Jobs at Machinify

More Information Technology Jobs

Find similar Sr. Director | Engineering, ML jobs: