Hadoop Developer

  •  

Indianapolis, IN

Industry: Business Services

  •  

8 - 10 years

Posted 67 days ago

  by    Alishaa Chhabra

This job is no longer available.

Profile:

  • Experienced Informatica BDM technology leader who understands distributed computing, ETL/ELT processes and the Hadoop ecosystem in order to design and develop data lake
  • Strong understanding of business domain around supply chain, procure to pay, and manufacturing
  • Ability to clearly articulate pros and cons of various technologies and platforms and propose the right architecture for the environment
  • Drive the implementation and configuration of required technologies to drive the business outcomes
  • Document use cases, solutions and recommendations


Experience Required:

  • Hands of experience on
  • Hortonworks Platforms. (HDP 2.4 , HDP 2.6 , HDF 3.0)
  • HDFS, MapReduce, Hive, Spark, Hbase, Zepplin, Zookeeper, Kafka, Apache Nifi, Sqoop, Presto, Rundeck, Nagios, Tez
  • Excellent knowledge on Data Ingestion process using Sqoop/Apache Nifi, Informatica BDM (Big Data Management)
  • Shell scripting experience using HDFS, Hive and PIG
  • Fine tuning the Spark JOBS with Java/Scala.
  • Hbase based applications development and fine tuning the Hbase configurations
  • Security setup on Hadoop Clusters. Kerberos, Knox, Ranger, Ranger KMS.
  • Installations and Upgradations of HDP and HDF
  • Troubleshooting the Issues while installation, Upgradation, Starting/ stopping the services.
  • Good Knowledge and experience on Kafka Cluster Installation and Management.
  • Batch processing, Realtime streaming and advanced analytics processes
  • Development using Scala/Java on Sprak Framework.
  • SSSD config setup to integrate with AD/LDAP
  • Benchmarking systems, analyzing system bottlenecks
  • Knowledge on Visualization tools like Tableau and Power bi is added advantage.



Salary

$100K - $120K