HubSpot

Sr. Machine Learning Engineer I

HubSpot$165K — $248K *
US-AnywhereRemote in United States
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience in a dedicated ML Engineer role
  • Strong Python skills; proficiency in PyTorch, VLLM, DSPy or similar frameworks
  • Hands-on experience with LLMs in production including prompt engineering and fine-tuning
  • Capability to transition from vague issues to targeted solutions through experimentation
  • Ability to work autonomously in an early-stage product setting

Responsibilities

  • Design and execute experiments to enhance agent quality
  • Build evaluation systems to track performance and prevent regressions
  • Optimize LLM inference regarding latency and cost
  • Collaborate with product teams for model selection and benchmarking
  • Translate customer quality challenges into actionable ML projects
  • Manage models from research phases through to production deployment

Benefits

  • Flexible work arrangements allowing for remote or in-office options
  • Opportunities for professional growth and development
  • Transparency in compensation practices and tailored individual packages
  • In-person onboarding and team-building events for remote employees
  • Supportive culture encouraging applications from diverse backgrounds
Full Job Description
POS-23565
About the Role

HubSpot's Agent Platform team is building Breeze Studio, our custom agent creation product that lets customers define, deploy, and improve AI agents that work on their behalf inside HubSpot. As a Machine Learning Engineer on the Agent Orchestration ML team, you'll own the models and systems that determine whether those agents are any good.

This is core ML work: prompt optimization, LLM evaluation, model fine-tuning, and inference infrastructure. You'll work directly with LLM vendors like OpenAI, run model performance experiments, and ship improvements that customers notice. The team is small (currently 2 MLEs), the surface area is large, and the scope is yours to define.

Custom agents are central to HubSpot's strategic direction as an AI-first CRM. This is not a supporting role.
What You'll Do
  • Design and run experiments to improve agent quality: better tool use, better reasoning, better outputs, using frameworks like DSPy and VLLM
  • Build and maintain evaluation infrastructure to measure what's working and catch regressions before customers do
  • Optimize LLM inference: latency, cost, model routing, and quality tradeoffs
  • Partner with product teams on model selection and performance benchmarking
  • Work closely with product engineers and PMs to translate customer quality problems into ML hypotheses and solutions
  • Own models end-to-end: from research and experimentation to production deployment
What We're Looking For
  • 5+ years of experience in a dedicated ML Engineer role (not ML-adjacent software engineering)
  • Strong Python skills; experience with PyTorch, VLLM, DSPy or similar LLM optimization frameworks
  • Hands-on experience working with large language models in production: prompt engineering, fine-tuning, evaluation, inference optimization
  • Ability to move from ambiguous problem ("this agent isn't performing well") to experimental design to shipped improvement
  • Comfort working with limited supervision in an early-stage product environment
Why This Role
  • Autonomy with impact: Small team, large surface area. Your work directly affects the quality of agents that hundreds of customers build.
  • Strategic positioning: Breeze Studio is how HubSpot competes in the AI-native CRM market. Agent quality is the bottleneck while you'll help own.
  • Interesting ML problems: Evaluating open-ended agent behavior, optimizing for latency and quality simultaneously, working at the frontier of LLM capabilities.


Pay & Benefits

The cash compensation below includes base salary, on-target commission for employees in eligible roles, and annual bonus targets under HubSpot's bonus plan for eligible roles. In addition to cash compensation, some roles are eligible to participate in HubSpot's equity plan to receive restricted stock units (RSUs). Some roles may also be eligible for overtime pay. Individual compensation packages are tailored to your skills, experience, qualifications, and other job-related reasons.

This resource will help guide how we recommend thinking about the range you see. Learn more about HubSpot's compensation philosophy.

Benefits are also an important piece of your total compensation package. Explore the benefits and perks HubSpot offers to help employees grow better.

At HubSpot, fair compensation practices aren't just about checking off the box for legal compliance. It's about living out our value of transparency with our employees, candidates, and community.

Annual Cash Compensation Range:

$165,500-$248,300 USD

We know the confidence gap and impostor syndrome can get in the way of meeting spectacular candidates, so please don't hesitate to apply - we'd love to hear from you.

If you need accommodations or assistance due to a disability, please reach out to us using this form.

At HubSpot, we value both flexibility and connection. Whether you're a Remote employee or work from the Office, we want you to start your journey here by building strong connections with your team and peers. If you are joining our Engineering team, you will be required to attend a regional HubSpot office for in-person onboarding. If you join our broader Product team, you'll also attend other in-person events, such as your Product Group Summit and other gatherings, to continue building on those connections.

If you require an accommodation due to travel limitations or other reasons, please inform your recruiter during the hiring process. We are committed to supporting candidates who may need alternative arrangements

Massachusetts Applicants: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.

Germany Applicants: (m/f/d) - link to HubSpot's Career Diversity page here.

India Applicants: link to HubSpot India's equal opportunity policy here.

About HubSpot

HubSpot is a leading growth platform. Since 2006, HubSpot has been on a mission to make the world more inbound. Today, over 100,000 customers in more than 120 countries use HubSpot's award-winning software, services, and support to transform the way they attract, engage, and delight customers. The company is headquartered in Cambridge, MA with offices in Dublin, Ireland; Singapore; Sydney, Australia; Tokyo, Japan; Berlin, Germany; Bogotá, Colombia; and Portsmouth, NH.
Learn more about HubSpot
Size
6,404 employees
Market Cap
$13.4 billion
Industry
Net Income
-$85 million
Founded
2006
5 Year Trend
+36.9%
Revenue
$883 million
NASDAQ

Similar Jobs

More Jobs at HubSpot

More Information Technology Jobs

Find similar Sr. Machine Learning Engineer I jobs: