Role DescriptionWe're looking for a
founding Sr. ML Infrastructure Engineer with a strong background in
distributed systems and building pipelines that scale. In this role, you'll
own the infrastructure that powers Tennr's AI-driven healthcare platform - the training, inference, and data pipelines that let our models handle growing traffic and an expanding product surface.
Our ML team builds in-house, proprietary VLMs, LLMs, and other models purpose-built for hard problems in healthcare.
You don't need deep ML experience to thrive here - what matters is a strong system design foundation and the interest to grow into the ML-side. If you think in systems, care about reliability, and want to expand into ML infrastructure, this is a rare chance to build foundational systems from the ground up.
Responsibilities- Architect, build, and scale the cloud infrastructure behind our ML training, inference, and data pipelines.
- Design resilient systems for model deployment, evaluation, and monitoring that stay reliable as traffic grows.
- Own observability across the stack - logging, metrics, tracing, and alerting.
- Troubleshoot production issues and continuously improve performance and efficiency.
- Collaborate with ML engineers, backend engineers, and cross-functional teams to integrate models cleanly with data pipelines and products.
Candidate Qualifications- 4+ years building and scaling infrastructure in production-distributed systems, cloud platforms, or data engineering.
- Strong backend software engineering fundamentals, with proficiency in Python and TypeScript.
- Hands-on experience with AWS, and PostgreSQL
- Solid grasp of observability, reliability, and production incident response.
- Comfortable with ambiguity and high ownership; you move fast and drive projects from idea to production in a startup environment.
- Interested in growing into ML infrastructure - prior ML ops/infra experience is not required.
- Nice to have: exposure to inference engines (vLLM, SGLang, TensorRT), or k8s.
Why Tennr?- Drive Impact: one of our company values is Cowboy, meaning you set the pace. You won't just talk about things, you'll get them done. And feel the impact.
- Develop Operational Expertise: learn the inner workings of scaling systems, tools, and infrastructure
- Innovate with Purpose: we're not just doing this for fun (although we do have a lot of fun). At Tennr, you'll join a high-caliber team maniacally focused on reducing patient delays across the U.S. healthcare system.
- Build Relationships: collaborate and connect with like-minded, driven individuals in our Hudson Square office 4 days/week
- Free lunch! Plus a pantry full of snacks.
Benefits- Beautiful new office at 345 Hudson Street
- Unlimited PTO
- 100% paid employee health benefit options
- Employer-funded 401(k) match
- Competitive parental leave
