Senior Research SDE

Microsoft   •  

Sunnyvale, CA

Industry: Technology


Not Specified years

Posted 37 days ago

This job is no longer available.

"Big data" is an acronym for collecting and processing massive data sets (viz., Petabyte scale) that is a becoming a well-established industry pattern. Apache Hadoop has become the industry standard for storing and computing on this data, and Microsoft is building Hadoop related services on Azure. CISL (Cloud and Information Services Lab) is deeply engaged with Microsoft's BigData teams (Cosmos, Hadoop). We are focused on several projects that build on the latest version of Hadoop/YARN and support analytics platforms such as Hive and Storm that are part of the Hadoop OSS ecosystem. Joining the CISL team is a fantastic opportunity to work with some of the best scientists/engineers in the industry who have had hands-on experience with managing Hadoop at scale. The group members have been involved with the Hadoop project for several years. Some of the software we build has already been released to the open source community. In particular, we built Rayon, a layer that adds resource reservation/planning and contributed the code back to Apache YARN. The CISL group has a strong bent towards innovation, tackling open problems, building novel solutions, and publishing papers. The team culture is results driven, and values colloboration and building robust shipping code. Efforts in the group range from developing novel ideas, to building prototypes for validation, to contributing code that runs in production settings, to publishing research papers in top conferences. As a SCIENTIST in CISL, you will work with a talented team of scientists/engineers to design and develop Hadoop-related services on Azure. This is a great opportunity to learn YARN, HIVE, Storm, and other OSS technologies and contribute to the code base, while also leveraging Microsoft cloud technologies such as Azure. The systems you build will used to power some of our biggest internal customers (such as, Skype, Bing). We are looking for candidates with systems building skills with a bent towards doing publishable research. Experience with distributed computing, Big data processing, Hadoop, etc. is a plus, but not a requirement. A Ph.D. degree in Computer Science (or equivalent) is required. A strong publication record with results obtained by building working systems is a plus. Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

  • Job number 399880