Hadoop Administrator

Resolvit   •  

Winston-salem, NC

Industry: IT Consulting/Services


Less than 5 years

Posted 368 days ago

Hadoop Administrator

We are seeking a Hadoop Administrator to be part of a creative, forward-thinking team. Our success at deploying skilled, highly knowledgeable experts has landed us on the Inc. 5000 list of America’s fastest-growing companies four times – and we’re just getting started.

As the Hadoop Administrator you will be responsible for the day-to-day operations of the Hadoop clusters and assisting with expansion of the Hadoop ecosystem in order to meet the demands of a growing environment and business needs. You will own, track, and resolve Hadoop related incidents and service requests, fulfill Service Level Agreements (SLAs), and review service related reports (e.g. backups, maintenance, monitoring, batch jobs) on a daily basis to ensure service-related issues are identified and resolved within established SLAs; respond to Hadoop-related alerts and escalations, working with application development to come up with strategic solutions to recurring problems; and introducing new components, services, and third party technologies into the environment. You will also work autonomously under very minimal supervision. Additionally, you will:

  • Interact with business stakeholders and/or development teams to ensure all the best Hadoop best practices are used within the enterprise and provide design guidance on the Hadoopinfrastructure
  • Architect Hadoop applications/platforms which meet customer/vertical expectations
  • Administer security using best practices and least privilege access policies, including server level, file system and databases
  • Provide on-going support for multiple Hadoop environments (non-prod/prod)
  • Forecast for cluster growth, an increased user-base, and growing demand for use of cluster resources
  • Work on strategic initiatives keeping in view next 3-5 years horizon
  • Provide data architecture and modeling advice as necessary
  • Provide guidance in stressful situations such as business continuity exercises and production down
  • Stay in touch with latest technical developments - keep up with best practices being followed in industry around Hadoop, Big Data, and Analytics
  • Work towards building a great team and next line of senior engineers
  • Test new technologies by doing proofs of concept and analyzing how they can be utilized
  • Create tools and applications that can be used in day-to-day operations
  • Mentor junior team members

What You’ll Need to be Successful:

  • Experience with any of the Hadoopdistributions such as Hortonworks HDP or Cloudera CDH
  • Solid understanding of Hadoop applications such as HDFS, YARN, Hive, Pig, Oozie, Slider, Sqoop, etc.
  • Experience managing Hadoop clusters using tools such as Ambari or Cloudera Manager
  • Solid understanding of cluster configurations and resource planning and utilization
  • Familiarity with scriptinglanguages such as Python and Bash
  • Solid understanding of how middleware and other components interact with Hadoop clusters and applications
  • Ability to implement best practices in security utilizing technologies such as Ranger and Kerberos
  • Solid understanding of data warehousing/archiving techniques
  • Solid understanding of multi-server administration
  • Solid understanding of database scalability fundamentals including partitioning, clustering, replication, multi-site databasearchitectures, high availability, and snapshots
  • Comfortable working in an agile environment with ability to effectively multi-task

Great Additional Skills:

  • Experience with Hadoop in-memory SQL like databasetechnologies such as LLAP, Kognitio and Presto
  • Experience with big data in the public cloud such as AWS, Google and Azure
  • Experience with other data technologies such as Incorta, Endeca, Tableau, Qliksense
  • Experience with ELT/ETL processes
  • Experience with otherdatabasetechnologies such as SQL Server, MySQL, Postgres, Informix, DB2