Developer Relations Engineer

Vast.ai Inc

$160K — $200K *
Technical Services
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Proficient in Linux, Docker, Python, and SSH for deploying AI models.
  • Experience with GPU management and debugging, including CUDA and NCCL.
  • Demonstrated public proof of technical work, including GitHub repositories or technical writing.
  • Ability to work autonomously without a prescribed task list.
  • Strong communication skills for explaining complex concepts clearly.

Responsibilities

  • Run weekly workloads using Vast to deploy and manage open source models.
  • Develop public repositories, Docker templates, and performance benchmarks for community use.
  • Create educational content such as guides, videos, and presentations based on your work.
  • Act as a knowledgeable representative in community forums like Discord and Reddit.
  • Participate in hackathons and conferences about once a month to showcase Vast's capabilities.
  • Provide direct feedback regarding technical challenges and documentation issues to the engineering team.

Benefits

  • Health, dental, vision, and life insurance coverage.
  • 401(k) retirement plan with company matching contributions.
  • On-site meals provided for employees.
  • Budget for travel and conferences related to professional development.
Full Job Description
The role

This is an engineering job that happens in public. You will be our heaviest user.

Most of your week goes to renting GPUs on Vast and building things on them. Serving open source models with vLLM and SGLang. Fine-tuning. Running ComfyUI pipelines. Keeping live inference endpoints up, including token endpoints on markets like OpenRouter. Writing the example repos, Docker templates, and benchmarks that other developers copy.

The rest of your week is spent showing your work. Short videos, technical write-ups, answers in Discord and on Reddit, hackathons. You are not building the Vast product. You are using it harder than any of our customers, in the open, and reporting back everything that breaks.

If you want a content calendar and a campaign plan, this is the wrong job. If you already spin up GPUs on weekends because you want to see whether the new model actually runs, keep reading.

What you'll do
  • Run real workloads on Vast every week. Deploy, fine-tune, and serve open source models, and keep live endpoints running.
  • Build public example repos, Docker templates, and benchmarks that developers can clone and use.
  • Turn what you build into teaching: guides, short videos, talks, livestreams.
  • Be the most technically credible voice in our Discord, on Reddit, and on X.
  • Represent Vast at hackathons and conferences, roughly one trip a month.
  • Report the friction, the breakage, and the missing docs straight to engineering and product.
What we need to see
  • You can take an open source model from Hugging Face to a running endpoint on rented GPUs with nobody helping you. Linux, Docker, Python, SSH.
  • You can debug the GPU stack. Driver and CUDA mismatches, out of memory errors, and multi-GPU configuration including NCCL and topology issues do not scare you.
  • Public proof of work you have shipped. A GitHub profile, technical writing, or live projects. We will ask you to walk us through code you wrote and explain the parts that went wrong.
  • You work without a roadmap and prefer it that way. Nobody here will hand you a task list.
  • You can explain a hard thing clearly, in writing and out loud.
Nice to have
  • Content or side projects that found a real audience.
  • Previous developer relations, community, or customer-facing work. Useful here, but it is a bonus and not the job.
  • vLLM or SGLang internals, distributed training with FSDP or DeepSpeed, CUDA.
  • Time at a cloud, GPU, AI infrastructure, or developer tools company.
First 90 days
  • Ship several public example projects on Vast, including at least one live serving endpoint.
  • Publish benchmarks or guides that developers actually use and pass around.
  • Become the recognizable technical voice in our community channels.
  • Represent Vast at a sponsored hackathon.
Compensation & benefits

$160,000 to $200,000 base, plus equity and bonus. Health, dental, vision, and life insurance. 401(k) with company match. Meals on site. Travel and conference budget. This role is on site in San Francisco or Los Angeles.

Similar Jobs

More Jobs at Vast.ai Inc

  • Developer Relations Engineer
    $160K — $200K *
    San Francisco, CA 94112 (San Francisco County)
    Consumer Technology
    In-Person
  • Developer Relations Engineer
    $160K — $200K *
    Los Angeles, CA 90011 (Los Angeles County)
    Technical Services
    In-Person
  • Developer Relations Engineer
    $160K — $200K *
    Los Angeles, CA 90011 (Los Angeles County)
    Information Technology
    In-Person
  • Developer Relations Engineer
    $160K — $200K *
    San Francisco, CA 94112 (San Francisco County)
    Information Technology
    In-Person
  • Controller
    $125K — $150K *
    Los Angeles, CA 90011 (Los Angeles County)
    Finance & Insurance
    In-Person

More Technical Services Jobs

Find similar Developer Relations Engineer jobs: