Data Platform Engineer
The Data Platform team processes terabytes of data a day as the backbone for our analytical systems. We are looking for a hands on senior developer to design, develop and test our data platform and continuously improve the performance, availability and scalability of our products. Experience with fast and scalable distributed systems is a must as well experience with structured and unstructured data sets.
6+ years of experience with distributed data storage systems/formats using parallel processes and/or columnar data stores such as Snowflake, Redshift, Druid, Cassandra, Parquet, Kudu, or HBase
4+ years of strong experience in any programming language like Python/Scala/Java. Exposure to Continuous Integration/Continuous Deployment & Test Driven Development a plus
2+ years of experienceworking with batch processing/ real-time systems using various open source technologies like Spark, MapReduce, NoSQL, Hive, etc.
Experienceworking with messaging frameworks such as Kafka or Kinesis
Cloud architectureexperience with a major cloud provider such as AWS
Expert knowledge in data modeling, data access, and data storage techniques for big data platforms
2+ experience leading small teams in an agile development process