Big Data Developer
Less than 5 years experience • Information Services
Please find the below details.
Job Role 1: Big Data Developer ( With AWS, Jenkins and Spark)
· Strong experience in Spark, 2+ years in AWS and hands on Jenkins.
· Excellent scripting skills in one or more (Java Script, Shell, Python etc.)
· Experience with Git, Subversion or other version control systems
· Experience with continuous integration and/or continuous delivery
· Hands on experience with configuration management tools, such as Puppet, Chef or AWS OpsWorks
· Hands on experience with HDFS, Map Reduce, Presto, Hive, Impala, Spark or similar technologies
· Ability to build libraries, user defined functions and frameworks on Hadoop eco system, Python and/or Spark
· Understanding of Hadoopdistributions such as EMR
· Experience with AWS or Cloud
· Orchestration tools experience like Airflow or similar open source tools
· Experience with Snowflake cloud data warehouse is a BIG plus
Hadoop, hive,Java, Hive,Sqoop, SQL, python, shell, mapreduce