Software Engineer, Data Platform

Whatnot

• $138K — $165K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience in software engineering, specifically in data platform systems.
  • Proven skills in developing scalable, high-performance distributed systems.
  • Strong expertise in streaming data technologies like Kafka, Flink, or Pulsar, particularly in platform construction.
  • Hands-on experience with real-time data pipeline design and operation at scale.
  • Proficient in evaluating architectural decisions specific to stream processing systems.
  • Experience in creating multi-tenant streaming infrastructures for diverse production needs.
  • Knowledge in managing cloud data stores such as Snowflake or BigQuery.

Responsibilities

  • Define and lead the technical direction for data platform systems at Whatnot.
  • Drive the development and refinement of the Flink platform for stream processing.
  • Design a multi-tenant streaming infrastructure that is robust and scalable.
  • Ensure core platform attributes like scalability and performance in stream processing.
  • Build systems to support real-time analytics and machine learning infrastructure.
  • Make integration decisions for data systems across the company and execute them cross-functionally.
  • Collaborate with engineering teams to facilitate speedy and safe development processes.

Benefits

  • Generous holiday and time-off policy.
  • Health insurance options including medical, dental, and vision coverage.
  • Support for remote work with office setup allowances and monthly cell phone and internet stipends.
  • Monthly wellness allowance and annual financial support for childcare and family planning.
  • Retirement benefits including a 401k match and pension plans for international employees.
  • Allowance to use and understand the app as part of job responsibilities.
  • Paid parental leave of 16 weeks plus gradual return to work arrangements.
Full Job Description
Role

The Data Platform team at Whatnot builds services that improve our core product experience and unlock meaningful business value. In this role, you will:
  • Define technical direction and lead development of critical data platform systems that power next-generation capabilities at Whatnot
  • Lead the buildout and evolution of our Flink platform, helping drive stream processing from early platform investment to production-ready usage across the company.
  • Design scalable, reliable, multi-tenant streaming infrastructure rather than simply building pipelines on top of an existing platform.
  • Own core platform concerns including scalability, performance, reliability, SLOs, and operational excellence for stream processing systems.
  • Build high-quality systems that support real-time analytics, event-driven applications, and machine learning infrastructure needs across Whatnot.
  • Make key decisions about how data systems should be integrated across Whatnot, and then partner cross-functionally to bring that architecture to life
  • Collaborate closely with engineering partners across product, platform, machine learning, and data to enable fast, safe, and scalable development
  • Help shape broader company architecture across stream processing, real-time systems, analytics, and content understanding
You

As our next Software Engineer, Data Platform, you should have 5+ years of experience, plus:
  • Ability to write well-tested, API-driven applications and services that run at scale in production
  • Track record of building scalable, high-performance distributed systems
  • Strong experience with streaming data systems such as Kafka, Flink, or Pulsar, with particular strength in building or evolving the platform layer itself - not just downstream pipelines.
  • Hands-on experience designing and operating stateful real-time data pipelines at scale, including concepts like checkpointing, state management, and watermarking.
  • Experience evaluating architectural tradeoffs in stream processing systems, including when Flink is the right solution and when it is not.
  • Experience building multi-tenant or end-to-end streaming infrastructure that supports multiple teams or production use cases.
  • Expertise in managing cloud data stores (Snowflake, BigQuery, Redshift, etc.) for processing and serving data products
  • Strong experience supporting operational systems to ensure uptime, reliability, and maintainability, including monitoring, alerting, and incident management

In addition to these role-specific qualifications, all engineering team members are expected to have:
  • Experience managing cloud technologies (AWS or Google Cloud) and comfort with infrastructure-as-code approaches (for example, Terraform)
  • Proficiency in at least one server-side programming language (preferably Python), common algorithms and data structures, and software design principles
  • Self-starter ethic, with the ability to thrive under a high level of autonomy
  • Exceptional interpersonal and communication skills
Benefits
  • Generous Holiday and Time off Policy
  • Health Insurance options including Medical, Dental, Vision
  • Work From Home Support
    • Home office setup allowance
    • Monthly allowance for cell phone and internet
  • Care benefits
    • Monthly allowance for wellness
    • Annual allowance towards Childcare
    • Lifetime benefit for family planning, such as adoption or fertility expenses
  • Retirement; 401k offering for Traditional and Roth accounts in the US (employer match up to 4% of base salary) and Pension plans internationally
  • Monthly allowance to dogfood the app
    • All Whatnauts are expected to develop a deep understanding of our product. We're passionate about building the best user experience, and all employees are expected to use Whatnot as both a buyer and a seller as part of their job (our dogfooding budget makes this fun and easy!).
  • Parental Leave
    • 16 weeks of paid parental leave + one month gradual return to work *company leave allowances run concurrently with country leave requirements which take precedence.

Please note: Whatnot will only contact you through official [redacted].com email addresses. If you see an email impersonating a Whatnot recruiter, please disregard and report it as spam.

Similar Jobs

More Jobs at Whatnot

More Information Technology Jobs

Find similar Software Engineer, Data Platform jobs: