Software Engineer, Machine Learning Infrastructure

Whatnot

$120K — $160K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science, Statistics, Applied Mathematics, or related field, or equivalent experience.
  • 4+ years of experience in developing machine learning systems and algorithms.
  • 3+ years of experience in software engineering with a focus on production systems for consumer-scale loads.
  • 1+ years of experience in developing software using Python.
  • Experience with operational, search, and key-value databases (e.g., PostgreSQL, DynamoDB, Elasticsearch, Redis).
  • Familiarity with cloud platforms like AWS and their managed services.
  • Strong communication and documentation skills.

Responsibilities

  • Own the infrastructure for AI and ML models across business areas like growth, recommendations, and fraud prevention.
  • Prototype and deploy innovative ML architectures that influence user experience.
  • Design scalable infrastructure for low-latency, high-throughput model serving.
  • Develop distributed training and inference pipelines using GPUs and parallelism.
  • Tackle new technical challenges as AI is integrated across Whatnot's services.

Benefits

  • Flexible Time Off Policy and company-wide holidays, including breaks.
  • Comprehensive health insurance options (Medical, Dental, Vision).
  • Support for remote work with a home office setup allowance and monthly internet and cell phone reimbursement.
  • Monthly wellness allowance and annual childcare support; lifetime family planning benefits.
  • 401k plan with employer match and international pension plans.
  • Monthly allowance to use the platform as both buyer and seller to enhance user understanding.
  • 16 weeks of paid parental leave with a month of gradual return to work.
Full Job Description
Role

We're looking for builders-intellectually curious, highly entrepreneurial engineers eager to shape the future of AI and ML at Whatnot. You'll design and scale the core infrastructure that powers machine learning and self-hosted large language model applications across the company, working side by side with machine learning scientists to bring cutting-edge models into production and unlock entirely new product experiences. This means building systems that make advanced ML dependable and fast at scale-from low-latency, large model serving to distributed training & high-throughput GPU inference.

What you'll do:
  • Own the infrastructure powering AI and ML models across critical business surfaces-supporting growth, recommendations, trust and safety, fraud, seller tooling, and more.
  • Prototype, deploy, and productionalize novel ML architectures that directly shape user experience and marketplace dynamics.
  • Design and scale inference infrastructure capable of serving large models with low latency and high throughput.
  • Build distributed training and inference pipelines leveraging GPUs and both model and data parallelism.
  • Stretch beyond your comfort zone to take on new technical challenges as we scale AI across Whatnot's ecosystem.

US Based: We offer flexibility to work from home or from one of our global office hubs, and we value in-person time for planning, problem-solving, and connection. Team members in this role must live within commuting distance of our New York, Seattle, Los Angeles, and San Francisco hubs.

You

People who do well at Whatnot tend to be comfortable figuring things out as they go, biased toward action, and genuinely curious about what they're building. They care more about outcomes than credit and stay close to the product and the people using it.

As our next AI/ML Platform Engineer you should have 4+ years of professional experience developing machine learning systems and algorithms, plus:
  • Bachelor's degree in Computer Science, Statistics, Applied Mathematics or a related technical field, or equivalent work experience.
  • 3+ years of software engineering experience building and maintaining production systems for consumer-scale loads.
  • 1+ years of professional experience developing software in Python
  • Ability to work autonomously and drive initiatives across multiple product areas and communicate findings with leadership and product teams.
  • Experience with operational, search, and key-value databases such as PostgreSQL, DynamoDB, Elasticsearch, Redis.
  • Firm grasp of visualization tools for monitoring and logging e.g. DataDog, Grafana.
  • Familiarity with cloud computing platforms and managed services such as AWS Sagemaker, Lambda, Kinesis, S3, EC2, EKS/ECS, Apache Kafka, Flink.
  • Professionalism around collaborating in a remote working environment and well tested, reproducible work.
  • Exceptional documentation and communication skills.
Benefits
  • Flexible Time off Policy and Company-wide Holidays (including a spring and winter break)
  • Health Insurance options including Medical, Dental, Vision
  • Work From Home Support
    • Home office setup allowance
    • Monthly allowance for cell phone and internet
  • Care benefits
    • Monthly allowance for wellness
    • Annual allowance towards Childcare
    • Lifetime benefit for family planning, such as adoption or fertility expenses
  • Retirement; 401k offering for Traditional and Roth accounts in the US (employer match up to 4% of base salary) and Pension plans internationally
  • Monthly allowance to dogfood the app
    • All Whatnauts are expected to develop a deep understanding of our product. We're passionate about building the best user experience, and all employees are expected to use Whatnot as both a buyer and a seller as part of their job (our dogfooding budget makes this fun and easy!).
  • Parental Leave
    • 16 weeks of paid parental leave + one month gradual return to work *company leave allowances run concurrently with country leave requirements which take precedence.

Similar Jobs

More Jobs at Whatnot

More Information Technology Jobs

Find similar Software Engineer, Machine Learning Infrastructure jobs: