Lead Data Engineering Consultant

Category: Software Development/ Engineering

Main location: Canada, Ontario, Toronto

Position ID:J0326-2496

Employment Type: Full Time

Position Description:

This role is hybrid and requires you to be at our downtown Toronto office at a minimum 2 days per week - subject to change at any time.

Your future duties and responsibilities:
• Conduct code reviews to ensure that the converted code meets all performance, scalability, and functional standards before it is handed over to the Application Development (AD) team.
• Own the quality assurance process, identifying and troubleshooting any issues that arise during the code migration.
• Provide technical leadership and direction to the team, ensuring best practices are followed throughout the migration.
• Collaborate with stakeholders to ensure all data-related issues are addressed, and that the solution complies with data governance policies.
• Define data engineering architecture, best practices, and governance on Databricks.
• Lead development of ETL/ELT pipelines using PySpark, Delta Live Tables, and SQL.
• Manage CI/CD for Databricks (Repos, Workflows, Git integration).
• Oversee data quality, cataloging, and Unity Catalog governance.
• Drive performance optimization, cluster cost optimization, and monitoring.
• Mentor engineers and oversee code reviews and delivery.

Required qualifications to be successful in this role:

. Deep expertise in PySpark, Delta Lake, notebooks, Workflows.
. Strong Azure background (Data Lake, ADF, Key Vault, EventHub/Synapse).
. Experience building Lakehouse architectures.
. Knowledge of Unity Catalog, cluster policies, workspace admin.
. Solid understanding of DevOps + Git-based engineering workflows.
. Strong communication and stakeholder management.

Key Skills
. PySpark + SQL
. Delta Lake optimization (Z-order, OPTIMIZE, partitioning)
. Streaming pipelines (Auto Loader, structured streaming)
. Workflow orchestration (Jobs, Workflows)
. Strong debugging of distributed systems

**CGI is providing a reasonable estimate of the pay range for this role. The determination of this range includes factors such as skill set level, geographic market, experience and training, and licenses and certifications. Compensation decisions depend on the facts and circumstances of each case. A reasonable estimate of the current range is $95,000-$145,000. This role is an existing vacancy.

#LI-BN

Use of the term 'engineering' in this job posting refers to the technical sense related to Information Technology (IT) and does not imply that the individual practices engineering or possesses the requisite license as prescribed by the applicable provincial or territorial engineering regulator. We are seeking individuals with expertise in IT engineering-related functions, but licensure from an engineering regulator is not a prerequisite for this position. Engineering is a regulated profession in Canada which is restricted in terms of use of titles and designation.

Skills:

• Data Engineering
• NoSQL
• Real-Time Appliance
• English