Sr. Hadoop Developer

LabCorp   •  

Burlington, NC

Industry: Patient Care

  •  

5 - 7 years

Posted 383 days ago

This job is no longer available.

Job Description

The Senior HadoopDeveloper will be responsible to implement and maintain solutions in our HDFS cluster. You will be responsible for coordinating data requests from the various teams, reviewing and approving efficient approaches to ingesting, extracting, transferring and maintaining data. In addition, you'll work with team members to mentor otherdevelopers to grow their knowledge and expertise. You'll be working in a fast-paced and high-volume processing environment, where quality and attention to detail are vital.

PRIMARY RESPONSIBILITIES

  • Provide oversight and guidance to our HDFS team
  • Design and develop HDFS-based solutions in Hive, Spark, Talend, HBASE, Pig, Flume, Kafka
  • Programming using Hive QL to generate reports
  • Writing Scoop Jobs to Import/Export data from Hadoop
  • Programming using Shell script/Python to create automation scripts
  • Programming using Java and Map Reduce framework
  • Programming using SQL and SQL/RDBMS utilities
  • Work closely with Technology Leadership, Product Managers, and Reporting Team for understanding the functional and system requirements
  • Work closely with our QA Team to ensure data integrity and overall system quality

Requirements

 REQUIREMENTS

  • BS/BA degree in Computer Science, Information Systems or related field
  • Atleast 5 years in a working environment utilizing Hadoop and related technologies like MapReduce, Spark, Hive, PIG, Hbase, Parquet and AVRO

KNOWLEDGE AND PREFERRED SKILLS

  • Exposure to RDBMS: Microsoft SQL Server, Oracle, MySQL
  • 7 years in a working environment utilizing Hadoop and related technologies like MapReduce, Spark, Hive, PIG, Hbase, Parquet and AVRO
  • Familiarity with Linux OS
  • Understanding of Data architecture, replication, and administration
  • Experience in working with real-time data feeds
  • Strong debugging skills to troubleshoot production issues
  • Comfortable working in a team environment
  • Hands on experience with Shell Scripting, Java, and SQL
  • Ability to identify problems, and effectively communicate solutions to peers and management
  • Team lead experience
  • Understanding of Data architecture
  • NoSQL/Big Data
  • Programming in C/C++, Java, Scala
  • Apache Spark
  • Agile/Scrum methodologies

Requisition Number 17-83506