Senior Staff Data Lake Engineer (714893)

Netpace, Inc.

$130K — $180K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • MS or higher degree in Computer Science or related field
  • 5+ years of software development experience
  • Demonstrable experience in designing and implementing complex software components
  • Excellent coding skills in Java or C++
  • Hands-on experience with Big Data components/frameworks like Hadoop, Spark, HBase, HDFS, Hive, NoSQL, and Relational databases

Responsibilities

  • Design and develop distributed storage and query engine for various data sources
  • Create a data lake storage subsystem ensuring low latency and high throughput
  • Develop algorithms for optimizing storage subsystem management based on query load
  • Build tools for big data consumers to optimize and automate their processes
  • Implement metadata module, data governance, and security for cloud services

Benefits

  • Opportunities for professional growth in cutting-edge big data technologies
  • Work collaboratively in a small, agile team environment
  • Engage in innovative projects that influence the future of data cloud services
  • Enhance your expertise in building autonomous data systems
  • Contribute to impactful solutions for diverse consumer needs
Full Job Description
As a core member, you will be part of the team that focuses on the next generation Huawei Data Lake Cloud Services. Your primary responsibility includes designing and developing: - Distributed storage and query engine for heterogeneous data sources, including graph databases, key/value store, high performance parallel computing, data consistency and durability, data access path memory and I/O optimization, and query execution. - Data lake storage subsystem that provides low latency and high throughput for bulk data ingestion and point query, particularly large scale graph data. - Algorithms for analyzing query workload and intelligently managing the storage subsystem on optimizing the various system components. The goal is a complete autonomous system. - Big data tools that facilitate various consumers (users or programs), in terms of optimizing or automating the system. - The metadata module, data governance and security for the data lake cloud services. This position requires carrying out exploratory work to deliver project results so we are looking for candidates who had designed software of his/hers to solve a problem and is of good coding skills; our team is small so the contractor is expected to be a self-starter to handle design and implementation of the project from start to finish to meet the goal. Requirements: - MS or higher degree in Computer Science or related field - 5+ years of software development experience - Demonstrable experience in both designing and implementing complex software components. - Excellent coding skills in Java or C++ - Hands-on experience in any of Big Data Components/Frameworks, such as Hadoop, Spark, HBase, HDFS, Hive, NoSQL, and Relational databases.

Similar Jobs

More Jobs at Netpace, Inc.

More Information Technology Jobs

Find similar Senior Staff Data Lake Engineer (714893) jobs: