TD Bank

Senior Data Engineer :Scala, Spark, Python, Hadoop, Databricks

TD Bank • $126K — $164K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 5+ years of experience in data engineering with a focus on Python, Scala, and Spark.
  • Strong understanding of data warehousing and ETL processes.
  • Hands-on experience with cloud data platforms like Azure.
  • Familiarity with big data technologies such as Hadoop, Kafka, and Hive.
  • Proficiency in SQL and experience with both relational and NoSQL databases.
  • Excellent problem-solving skills and strong communication abilities.

Responsibilities

  • Design and develop distributed data processing systems using Scala, Python, and Apache Spark.
  • Build and optimize large-scale data pipelines for batch and streaming data.
  • Collaborate with data scientists and analysts to fulfill data requirements.
  • Maintain real-time data processing solutions with Scala and Spark.
  • Develop ETL processes to integrate data from various sources.
  • Ensure data quality and integrity through automated testing and monitoring.
  • Work with DevOps teams to deploy and manage CI/CD and data pipelines.

Benefits

  • Ongoing training and development opportunities to enhance your skills.
  • A collaborative work environment with a focus on teamwork and innovation.
  • Access to a global network of professionals in various financial sectors.
  • Involvement in community-minded initiatives and activities.
Full Job Description
Work Location:
Toronto, Ontario, Canada

Hours:
37.5

Line of Business:
Technology Solutions

Pay Details:
$126,800 - $164,100 CAD

This role is eligible for a discretionary variable compensation award that considers business and individual performance.

Job Description:
Department Overview

TD Securities provides a wide range of capital market products and services to corporate, government and institutional clients who choose us for our knowledge and experience in six key areas of finance: Investment Banking, Debt Capital Markets, Institutional Equities, Private Equity, Precious Metals and Foreign Exchange & Money Market. Our services include the underwriting and distribution of new debt and equity issues, providing advice on strategic acquisitions and divestitures, and executing daily trading and investment needs.

With more than 6,500 professionals operating out of 40 cities across the globe, we help clients meet their needs today and prepare for tomorrow. Our services include underwriting and distributing new issues, providing trusted advice and industry-leading insight, extending access to global markets, and delivering integrated transaction banking solutions.

We are growth-oriented, people-focused, and community-minded. As a team, we work to deliver value for our clients every day.

Team Description

The Counterparty Credit Risk group at TD Securities is seeking experienced Data Engineers to build the next generation of risk computation platforms. The core mission of the applications we build is to help the firm quantify, understand, and reduce our external total exposure in case of adverse market conditions. We operate within a modern and complex area of finance, operating with sophisticated computational models, supporting billions of calculations daily and leveraging Big Data storage for analytics and data distribution.

Position Overview:

As a Senior Data Engineer in the XVA and CCR data development team, you will be responsible for designing, building, and maintaining scalable data pipelines that power our analytics and data-driven applications. You will work closely with cross-functional teams to deliver high-quality data solutions and ensure the integrity and availability of our data platforms.

Key Responsibilities:

  • Design and develop distributed data processing systems using Scala, Python and Apache Spark.
  • Build and optimize large-scale data pipelines for batch and streaming data using Spark.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  • Maintain a real-time data processing solution build on Scala , Spark , pyspark and Akka/Pekko framework.
  • Develop and maintain ETL processes to transform and integrate data from various sources.
  • Experience supporting Credit Risk, Counterparty Credit Risk (CCR), XVA, or Regulatory Reporting data platforms.
  • Hands-on experience with Databricks Unity Catalog, data lineage, data classification, and access governance frameworks.
  • Understanding of FpML, financial product modeling, and Capital Markets reference data standards.
  • Ensure data quality, reliability, and integrity through automated testing and monitoring.
  • Work with DevOps teams to deploy and manage CI/DC and data pipelines in a cloud environment.
  • Optimize and tune Spark jobs for performance and scalability.
  • Participate in code reviews and contribute to the improvement of engineering best practices.
  • Stay up-to-date with the latest technologies and best practices in data engineering.


Qualifications:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 5+ years of experience in data engineering with a strong focus on Python, Scala and Spark.
  • Strong understanding of data warehousing and data modeling concepts and ETL processes.
  • Hands-on experience with cloud data platforms like Azure ADLS, Azure Databricks and Dremio.
  • Hands-on Experience with big data technologies such as Hadoop, Kafka, Hive and HBase.
  • Hands-on experience with the Akka/Pekko framework for building distributed systems.
  • Understanding of data communication protocol like REST and GRPC
  • Proficiency in SQL and experience with relational and NoSQL databases.
  • Experience with cloud platforms (e.g., GCP, Azure) and containerization technologies (e.g., Docker, Kubernetes) is a plus.
  • Excellent problem-solving skills and ability to work independently and in a team.
  • Strong communication skills and ability to collaborate with cross-functional teams.


Preferred Skills:

  • Experience with Apache Kafka or Confluent is a plus.
  • Proficiency with C# for excel addins.
  • Experience with CI/CD pipelines and infrastructure as code (IaaC).
  • Knowledge of data governance and security best practices.
  • Knowledge of Capital Markets is a plus
  • Familiarity with machine learning and data science workflows.
  • Experience with real-time analytics and event-driven architectures.


Non-Technical Skills:
  • Experience in collaborating efficiently within a global team
  • Strong communication skills
  • Demonstrable experience working in a fast-paced environment, and supportive of flexible goals aligned with business priorities
  • Knowledge of derivatives pricing and capital markets is a plus


Additional Information:

Join in on what others in TD Global Technology Solutions are doing:
  • Inspire a positive work environment and help champion quality, innovation, teamwork and service to the business.
  • Learn voraciously, stretch your thinking, share your knowledge and educate others.
  • Communicate and collaborate with both technical and non-technical professionals.
  • Cultivate winning relationships by building trust with business and technology partners.
  • Share our commitment to productivity, effectiveness and operational efficiency.


#LI-Tech

Language Requirement (Quebec only):
Sans Objet

About TD Bank

TD Securities offers a range of advisory and capital market services to its clients. The company's range of services includes research, investment banking, capital markets, and global transaction banking. Research consists of commodity and equity research. Investment banking consists of mergers, acquisitions, industry expertise, and credit origination. Global transaction banking consists of trade finance, cash management, and correspondent banking. TD Securities was founded in 1855 and is based in Ontario.

TD Bank Careers

Join the vibrant team at TD Bank, one of North America's leading financial services organizations, where innovation, leadership, and growth go hand in hand. At TD Bank, we are committed to fostering a culture of diversity and inclusion, making it an ideal place for ambitious professionals to thrive. Work You’ll Do At TD Bank, your professional journey is bolstered by a robust support system. From your first interview to every career milestone, you will find opportunities for growth and leadership. Our team is dedicated to helping you develop the skills necessary for success in the ever-evolving financial sector. TD Bank offers a variety of job opportunities across multiple fields, from customer service to investment banking. Each position at TD Bank is a chance to contribute to our culture of innovation and exceptional client service. Internship Programs Kickstart your career with a TD Bank internship. Our programs provide invaluable industry exposure and hands-on experience, making them a perfect starting point for students and recent graduates eager to make their mark in the banking industry. Interns at TD Bank enjoy the unique opportunity to work alongside seasoned professionals, gaining insights that are crucial for future employment. Benefits and Growth TD Bank is deeply committed to the well-being and continuous growth of our team members. We offer competitive benefits packages that cover health, finance, and family care. Our employees enjoy comprehensive health insurance, retirement plans, and generous paid time off, among other perks. Moreover, TD Bank encourages professional development through various training programs, including leadership development and diversity training. These initiatives ensure that our team remains at the forefront of industry standards and best practices. Join Our Team Explore the numerous career paths available at TD Bank and discover how your skills and interests align with our mission. We are actively hiring and continually looking for talented individuals who are passionate about banking and customer service. Networking and Professional Development At TD Bank, we believe in the power of networking and collaboration. Our employees have access to a wide range of networking events, workshops, and seminars that promote career development and professional growth. These platforms not only enhance your professional skills but also expand your industry connections. Stay Connected Keep up to date with the latest at TD Bank Careers by subscribing to our job alert emails. Tailor your subscription to match your career preferences and get the latest news, insider tips, and job opportunities delivered straight to your inbox. Explore job opportunities at TD Bank and be part of a team that values hard work, creativity, and a diverse workplace culture. Your next great career move is just a click away. SEARCH TD BANK JOBS Join us at TD Bank and let your ambition lead you to a rewarding career filled with opportunities to learn, grow, and innovate.
Learn more about TD Bank
Size
90,000 employees
Market Cap
$117.9 billion
Industry
Net Income
-$6.9 million
5 Year Trend
+6.6%

Similar Jobs

More Jobs at TD Bank

More Information Technology Jobs

Find similar Senior Data Engineer :Scala, Spark, Python, Hadoop, Databricks jobs: