Software Engineer, Data Platform

Whatnot

• $130K — $155K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience in software engineering, specifically with distributed systems.
  • Ability to develop well-tested, API-driven applications for production.
  • Strong background in streaming data technologies like Kafka and Flink, focusing on platform development.
  • Hands-on skills in managing stateful real-time data pipelines.
  • Proficient in cloud data management (e.g., Snowflake, BigQuery).
  • Experience with AWS or Google Cloud and infrastructure-as-code tools like Terraform.
  • Effective communicator with a self-starter attitude.

Responsibilities

  • Define and lead the technical direction for the data platform systems.
  • Oversee the evolution of the Flink platform for company-wide stream processing.
  • Design scalable, reliable, multi-tenant streaming infrastructure from scratch.
  • Manage core concerns: scalability, performance, reliability, and operational excellence.
  • Develop systems for real-time analytics and machine learning infrastructure.
  • Make integration decisions for data systems and coordinate cross-functional efforts.
  • Collaborate with engineering teams to promote scalable development processes.
  • Shape the architectural vision for stream processing and analytics across the company.

Benefits

  • Generous Holiday and Time off Policy.
  • Comprehensive Health Insurance including Medical, Dental, and Vision.
  • Work From Home Support with setup allowances and monthly tech stipends.
  • Care benefits including wellness allowances and childcare support.
  • Retirement support with 401k options and employer matching.
  • Unique 'dogfooding' allowance for hands-on product experience as both buyer and seller.
  • Substantial Paid Parental Leave with progressive return-to-work options.
Full Job Description
Role

The Data Platform team at Whatnot builds services that improve our core product experience and unlock meaningful business value. In this role, you will:
  • Define technical direction and lead development of critical data platform systems that power next-generation capabilities at Whatnot
  • Lead the buildout and evolution of our Flink platform, helping drive stream processing from early platform investment to production-ready usage across the company.
  • Design scalable, reliable, multi-tenant streaming infrastructure rather than simply building pipelines on top of an existing platform.
  • Own core platform concerns including scalability, performance, reliability, SLOs, and operational excellence for stream processing systems.
  • Build high-quality systems that support real-time analytics, event-driven applications, and machine learning infrastructure needs across Whatnot.
  • Make key decisions about how data systems should be integrated across Whatnot, and then partner cross-functionally to bring that architecture to life
  • Collaborate closely with engineering partners across product, platform, machine learning, and data to enable fast, safe, and scalable development
  • Help shape broader company architecture across stream processing, real-time systems, analytics, and content understanding
You

As our next Software Engineer, Data Platform, you should have 5+ years of experience, plus:
  • Ability to write well-tested, API-driven applications and services that run at scale in production
  • Track record of building scalable, high-performance distributed systems
  • Strong experience with streaming data systems such as Kafka, Flink, or Pulsar, with particular strength in building or evolving the platform layer itself - not just downstream pipelines.
  • Hands-on experience designing and operating stateful real-time data pipelines at scale, including concepts like checkpointing, state management, and watermarking.
  • Experience evaluating architectural tradeoffs in stream processing systems, including when Flink is the right solution and when it is not.
  • Experience building multi-tenant or end-to-end streaming infrastructure that supports multiple teams or production use cases.
  • Expertise in managing cloud data stores (Snowflake, BigQuery, Redshift, etc.) for processing and serving data products
  • Strong experience supporting operational systems to ensure uptime, reliability, and maintainability, including monitoring, alerting, and incident management

In addition to these role-specific qualifications, all engineering team members are expected to have:
  • Experience managing cloud technologies (AWS or Google Cloud) and comfort with infrastructure-as-code approaches (for example, Terraform)
  • Proficiency in at least one server-side programming language (preferably Python), common algorithms and data structures, and software design principles
  • Self-starter ethic, with the ability to thrive under a high level of autonomy
  • Exceptional interpersonal and communication skills
Benefits
  • Generous Holiday and Time off Policy
  • Health Insurance options including Medical, Dental, Vision
  • Work From Home Support
    • Home office setup allowance
    • Monthly allowance for cell phone and internet
  • Care benefits
    • Monthly allowance for wellness
    • Annual allowance towards Childcare
    • Lifetime benefit for family planning, such as adoption or fertility expenses
  • Retirement; 401k offering for Traditional and Roth accounts in the US (employer match up to 4% of base salary) and Pension plans internationally
  • Monthly allowance to dogfood the app
    • All Whatnauts are expected to develop a deep understanding of our product. We're passionate about building the best user experience, and all employees are expected to use Whatnot as both a buyer and a seller as part of their job (our dogfooding budget makes this fun and easy!).
  • Parental Leave
    • 16 weeks of paid parental leave + one month gradual return to work *company leave allowances run concurrently with country leave requirements which take precedence.

Please note: Whatnot will only contact you through official [redacted].com email addresses. If you see an email impersonating a Whatnot recruiter, please disregard and report it as spam.

Similar Jobs

More Jobs at Whatnot

More Information Technology Jobs

Find similar Software Engineer, Data Platform jobs: