5 - 7 years experience •
Must be GC OR Citizen as the client won't sponsor
Skills (Top 3 Required) * Backend programming in free-standing languages ? Python/Java/Scala * Working experience in relational databases - principles, SQL etc.
Hands on experience in HiveQL. Familiarity with data loading tools like SQOOP.
* Working experience in Unix and workflow/schedulers such as Oozie and AutoSys.
* Knowledge of Object Oriented Design principles. * Ability to factor in scalability and performance considerations into design and coding. *Experience in Spark, mid level expertise. *
Knowledge of security and data privacy considerations.
* Knowledge of existing best practices/standards.
* Prior experience working in the Banking and Financial domain would be a plus.
Description HadoopDeveloper with around 7years total experienceResponsibilities include software development using the Agile development process on the Cloudera Hadoop platform.
* Participate in Agile development on a large Hadoop-based data platform as a member of a distributed team. * Code programs to load data from diverse data sources into Hive structures using SQOOP and other tools. * Translate complex functional and technical requirements into detailed design. * Analyze vast data stores. * Code business logic using Scala on Apache Spark. * Create workflows using Oozie. * Code and test prototypes. * Code to existing frameworks where applicable.