Big Data Developer (Java / Scala) - AML Tech

Category: Software Development/ Engineering

Main location: Canada, Ontario, Toronto

Position ID:J0426-0635

Employment Type: Full Time

Position Description:

This is a hybrid role requiring on-site presence at the Toronto or client office a minimum of 4 days per week (subject to change).

Your future duties and responsibilities:
• Work within an Agile cross functional team to design, develop and maintain data ingestion flows and evolve the platform to orchestrate them.
• Design and implement data pipelines, framework, and ETL processes.
• Ensure data quality, security, and performance.
• Develop and optimize SQL queries, stored procedures, and views.
• Integrate Snowflake with other data sources and BI tools.
• Monitor and troubleshoot data jobs and platform issues.
• Develop and maintain comprehensive documentation for data pipelines, transformations, and data models.

Required qualifications to be successful in this role:
• 5+ years of Experience with Big Data technologies used for ETL: Hadoop, Spark, Hive
• Well versed with Snowflake Platform.
• Strong SQL skills and knowledge of data modeling.
• Programming Experience with Scala or Java an API Development.
• Experience with ETL tools (e.g., Informatica, Talend, Apache Airflow).
• Familiarity with any of the cloud platforms (Preferably AWS).
• Knowledge on Gen AI to generate code and improve developer proficiency
• Knowledge of Python or other scripting languages is a plus.
• Excellent problem-solving and communication skills.
• Knowledge of SCM, Infrastructure-as-code, and CI/CD pipelines.
• Bachelor's or master's degree in computer science, Data Engineering and, or a related field.

Nice to Have
• AWS Cloud Knowledge, Glue It
• Experience with workflow management tools like: Apache Airflow
• Experience with Continuous Integration tools - Git Actions, GitHub, Automated Testing tools, Git, or similar tools.
• Experience with Docker/Kubernetes/Containers/OCP4
• Shell Scripting

CGI is providing a reasonable estimate of the pay range for this role. The determination of this range includes factors such as skill set level, geographic market, experience and training, and licenses and certifications. Compensation decisions depend on the facts and circumstances of each case. A reasonable estimate of the current range is $95,000-$145,000. This role is an existing vacancy.

#LI-BN

Skills:

• Financial Services
• Hadoop Hive
• Java
• Python
• Scala
• Snowflake
• SQLite
• GIT
• Shell Script