Senior Database Administrator in Buffalo, NY

View All Technical Services jobs


Technical Services   •  

Not Specified years

Posted 8 weeks ago

Responsible for implementation and ongoing administration of Hadoop infrastructure

Aligning with the Data engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments

Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, Spark access for the new users

Cluster maintenance as well as creation and removal of nodes using tools like Cloudera Manager Enterprise, etc.

Performance tuning of Hadoop clusters and Hadoop MapReduce routines

Screen Hadoop cluster job performances and capacity planning

Monitor Hadoop cluster connectivity and security

Manage and review Hadoop log files

File system management and monitoring

HDFS support and maintenance

Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability

Collaborating with application teams to perform Hadoop updates, patches, version upgrades when required

General operational expertise such as good troubleshooting skills, understanding of systems capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks

Additional Good to Have\:

They should be able to deploy Hadoop cluster, add and remove nodes, keep track of jobs, monitor critical parts of the cluster, configure namenode high availability, schedule and configure it and take backups

Solid Understanding on premise and Cloud network architectures

Additional Hadoop skills like Sentry, Spark, Kafka, Oozie, etc