Data Platform Engineer

Confidential Company  •  New York, NY

5 - 7 years experience  •  Software

$80K - $120K ($80K - $120K base + N/a, Employee Stocks)
Posted on 08/11/17 by Karen Escobar
New York, NY
5 - 7 years experience
Software
$80K - $120K
($80K - $120K base + N/a, Employee Stocks)
Posted on 08/11/17 by Karen Escobar

The Data Platform team processes terabytes of data a day as the backbone for our analytical systems. We are looking for a hands on senior developer to design, develop and test our data platform and continuously improve the performance, availability and scalability of our products.  Experience with fast and scalable distributed systems is a must as well experience with structured and unstructured data sets.

SKILLS:

  • 6+ years of experience with distributed data storage systems/formats using parallel processes and/or columnar data stores such as Snowflake, Redshift, Druid, Cassandra, Parquet, Kudu, or HBase

  • 4+ years of strong experience in any programming language like Python/Scala/Java.  Exposure to Continuous Integration/Continuous Deployment & Test Driven Development a plus

  • 2+ years of experienceworking with batch processing/ real-time systems using various open source technologies like Spark, MapReduce, NoSQL, Hive, etc.

  • Experienceworking with messaging frameworks such as Kafka or Kinesis

  • Cloud architectureexperience with a major cloud provider such as AWS

  • Expert knowledge in data modeling, data access, and data storage techniques for big data platforms

PLUS:

  • 2+ experience leading small teams in an agile development process

Not the right job?
Join Ladders to find it.
With a free Ladders account, you can find the best jobs for you and be found by over 20,0000 recruiters.