AssemblyAI

Senior Software Engineer, Inference

AssemblyAI$190K — $225K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Strong backend engineering experience, particularly with machine learning infrastructure and customer-facing APIs in production.
  • Comfortable with ambiguity, especially when research and product timelines do not align.
  • Genuine curiosity about AI/ML, with a desire to understand model capabilities for informed engineering decisions.
  • Strong collaboration skills for effective interaction with researchers, applied engineers, and clients.

Responsibilities

  • Design and ship customer-facing APIs to expose new model capabilities, owning the process from prototype to launch.
  • Scale inference infrastructure to accommodate over 1 million API users.
  • Collaborate with researchers to turn prototypes into reliable products meeting customer expectations.
  • Engage with customers and applied teams to gather feedback for product design and research direction.
  • Contribute to various areas of the tech stack including backend services, SDKs, and internal tooling.

Benefits

  • Inclusive company culture that values diversity and equity in hiring and retention.
  • Opportunities for professional growth and development in a cutting-edge AI environment.
Full Job Description
About the role:

We're hiring a Software Engineer to help turn cutting-edge AI research into products our customers rely on every day. You'll sit on a fast-paced engineering team between our research org and our Applied teams, taking new model capabilities from proof of concept to robust, well-documented APIs serving production traffic at scale.
What You'll Do:
  • Design and ship customer-facing APIs that expose new model capabilities, owning them from prototype through launch and ongoing iteration.
  • Scale inference infrastructure to support our 1M+ api users
  • Partner with researchers to productionize new techniques. For example, turning a notebook or POC into something with the latency, reliability, and ergonomics customers expect.
  • Work with our customers and Applied teams to understand how users are building with our products, and feed that back into product design and research direction.
  • Contribute across the stack as needed: backend services, inference infrastructure, SDKs, internal tooling.
What You'll Need:
  • Strong backend engineering experience, including building and supporting machine learning infrastructure and/or customer-facing APIs in production.
  • Comfort operating with ambiguity. Research timelines and product timelines don't always line up, and you're energized rather than frustrated by that.
  • Genuine curiosity about AI/ML. You don't need to be a researcher, but you should want to understand what the models are doing well enough to make good engineering decisions around them.
  • Strong collaboration skills. You'll be working daily with researchers, applied engineers, and sometimes customers, people with very different contexts and priorities, and the role only works if you enjoy that.

Pay Transparency:

AssemblyAI strives to recruit and retain exceptional talent from diverse backgrounds while ensuring pay equity for our team. Our salary ranges are based on paying competitively for our size, stage, and industry, and are one part of many compensation, benefit, and other reward opportunities we provide.

There are many factors that go into salary determinations, including relevant experience, skill level, qualifications assessed during the interview process, and maintaining internal equity with peers on the team. The range shared below is a general expectation for the function as posted, but we are also open to considering candidates who may be more or less experienced than outlined in the job description. In this case, we will communicate any updates in the expected salary range.

The provided range is the expected salary for candidates in the U.S. Outside of those regions, there may be a change in the range which will be communicated to candidates throughout the interview process.

Salary range: $190,000 - $225,000

AI to Interview:

If you're selected for an interview, please review this resource to better understand how AssemblyAI approaches the use of AI in our interview process.
GDPR privacy notice:

Candidates from the EU should review this job applicant privacy notice before applying.
Keep Exploring AssemblyAI:

Speech-to-text | Streaming speech-to-text | Speech Understanding | LLM Gateway
Try the Playground
Our $50M Series C fundraise
Check us out on YouTube!

About AssemblyAI

AssemblyAI is an artificial intelligence company that provides speech recognition and natural language processing services. The company's platform enables developers to build applications that can transcribe audio and video into text, identify speakers, and understand the meaning of words and phrases. AssemblyAI's technology is used by businesses in a variety of industries, including media, healthcare, and education. The company was founded in 2017 and is headquartered in San Francisco, California.
Learn more about AssemblyAI
Size
50 employees
Industry
Founded
2017

Similar Jobs

More Jobs at AssemblyAI

More Information Technology Jobs

Find similar Senior Software Engineer, Inference jobs: