Senior Developer - Python / PySpark

Category: Software Development/ Engineering

Main location: Canada, Ontario, Toronto

Position ID:J0726-1653

Employment Type: Full Time

Position Description:

This role is hybrid and requires you to work from our downtown Toronto office and/or the client office a minimum of four (4) days per week. This requirement is subject to change based on business and client needs.

CGI is seeking a highly skilled Senior Developer with expertise in Python, PySpark, and enterprise data engineering to join our Capital Markets technology team.

In this role, you will design, develop, and optimize scalable data engineering solutions that support critical business functions across trading, risk, finance, and regulatory reporting. You will collaborate with business stakeholders, solution architects, and engineering teams to deliver cloud-native data platforms using modern Azure technologies.

If you enjoy solving complex data challenges, building high-performance data pipelines, and working in a fast-paced financial services environment, we'd like to hear from you.

Your future duties and responsibilities:
• Design, develop, and maintain scalable data engineering solutions using Python and PySpark.
• Build and optimize enterprise ETL/ELT pipelines for processing large volumes of market, trade, risk, and reference data.
• Develop high-performance data processing solutions using Apache Spark and Azure Databricks.
• Design and implement reliable data ingestion frameworks for internal and external data sources.
• Develop reusable data transformation, validation, and reconciliation frameworks.
• Optimize Spark applications for scalability, reliability, and performance.
• Implement data quality controls, monitoring, and governance best practices.
• Troubleshoot production issues and perform root cause analysis for data pipelines.
• Participate in architecture discussions, solution design, and code reviews.
• Contribute to CI/CD automation, DevOps practices, and release management.
• Collaborate closely with business stakeholders, data architects, analysts, and development teams to deliver strategic Capital Markets initiatives.
• Ensure all solutions comply with enterprise security, governance, and regulatory standards.

Required qualifications to be successful in this role:
• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related discipline.
• 6+ years of software development and data engineering experience.
• 4+ years of hands-on experience developing applications using Python and PySpark.
• Experience building large-scale distributed data processing solutions.
• Experience working with cloud-based data platforms and modern data architectures.
• Strong analytical, problem-solving, and communication skills.
Technical Skills
Programming & Data Engineering
• Python
• PySpark
• Apache Spark / Spark SQL
• Advanced SQL
• Object-Oriented Programming (OOP)
• Data Structures & Algorithms
• ETL/ELT development
• Data Modeling
• Data Warehousing concepts
• Performance tuning and optimization
• Batch and real-time data processing
Databases
• SQL Server
• Oracle
• PostgreSQL
• Snowflake
Cloud & DevOps
• Azure Databricks
• Azure DevOps
• Git
• CI/CD pipelines
• Unit Testing
• Agile/Scrum methodologies
• Code review best practices
Nice to Have
• Experience working in Capital Markets or Financial Services.
• Experience supporting Trading, Risk, Finance, or Regulatory Reporting platforms.
• Experience with enterprise data governance and data quality frameworks.
• Knowledge of Azure cloud-native services and modern data architecture patterns.

"CGI is providing a reasonable estimate of the pay range for this role. The determination of this range includes factors such as skill set level, geographic market, experience and training, and licenses and certifications. Compensation decisions depend on the facts and circumstances of each case. A reasonable estimate of the current range is $80,000-$130,000. This role is an existing vacancy."

#LI-GS!

Skills:

• Data Modeling
• ETL
• Financial Services
• Microsoft SQL Server
• Object Oriented Programming
• Python
• Spark SQL