Skill: Hadoop Support with DevOps
Must Have Technical/Functional Skills:
Primary Skill: Hadoop
Secondary: Linux, DevOps
Experience: Minimum10 years
Roles & Responsibilities:
Primary - Hadoop, Secondary- Linux with Devops
Key Responsibilities
• L1, L2 & L3 level support in Hadoop Platform
• Monitor and resolve HDFS and Ozone related issues.
• Investigate cluster performance, storage utilization, and capacity concerns.
• Manage quota requests, storage allocation, and capacity planning.
• Support platform maintenance and perform integration activities.
• Coordinate with application teams during incident and problem management.
• Create and maintain operational documentation, runbooks, and knowledge articles.
Required Qualifications
• Experience on L1, L2 & L3 level support in Hadoop Platform.
• Experience in Yarn, Spark and Impala job debugging and troubleshooting.
• Experience in addressing issues around NameNode, HDFS Space, File/Folder Permission & backups.
• Understanding and experience in query performance tuning and resource utilization tuning.
• Technical knowledge on relational databases, data warehousing and SQL skills.
• Hadoop, Kafka, Spark, Impala, Hive, HBase, Ozone etc.
• Strong knowledge of Hadoop Architecture, HDFS, Hadoop Cluster and Hadoop Administrators role.
• Intimate knowledge of fully integrated AD/Kerberos authentication.
• Experience setting up optimum cluster configurations.
• Debugging knowledge of YARN.
• Hands-on with analyzing various Hadoop log files, compression, encoding, & file formats.
• Expert level knowledge of Cloudera Hadoop components such as HDFS, Sentry, HBase, Kafka, Impala, SOLR, Hue, Spark, Hive, YARN, Zookeeper and Postgres.
• Strong technical knowledge: Unix/Linux; Database (Sybase/SQL/Oracle), Java, Python, Perl, Shell scripting, Infrastructure.
• Experience in Monitoring & Alerting, and Job Scheduling Systems.
• Being comfortable with frequent, incremental code testing and deployment.
• Strong grasp of automation / DevOps tools - Ansible, Jenkins, SVN, Bitbucket.
Tools Involved
• ETL tools: Hadoop Stack
• Job Scheduling tools: Autosys
• BI tools: Tableau; Tableau dashboard building connecting Hadoop-Hive Tables is equally preferred.
Salary Range - $95,000-$115,000 a year
TCS Employee Benefits Summary:
1. Discretionary Annual Incentive.
2. Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
3. Family Support: Maternal & Parental Leaves.
Insurance Options: Auto & Home Insurance, Identity Theft Protection.
4. Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
5. Time Off: Vacation, Time Off, Sick Leave & Holidays.
Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
