Senior Software Engineer, Big Data Infrastructure

HubSpot   •  

Cambridge, MA

Industry: Technology

  •  

Not Specified years

Posted 87 days ago

This job is no longer available.

We’re also operationally responsible for a huge volume of traffic to and from these datastores. Our HBase clusters serve over 3 million requests/second across 220+ tables, while our ElasticSearch clusters serve over 20k searches/second and 50k indexes/second to 90+ billion documents. Streaming that data to and from applications amounts to more than 3 GB/sec of data through our Kafka clusters, with hundreds of producers and consumers

What we’re looking for

  • Experienced with some or most of our datastores (HBase, Hadoop) as a user and/or operationally
  • Excited to build great tools for developers so they can work faster and more reliably
  • Interested in working with and supporting infrastructure at scale
  • Eager to learn and grow