Job Title: Sr Big Data Engineer
City: Toronto
State/Province: Ontario
Posting Start Date: 7/10/26
Job Description:
Job Description
Design, develop, and support scalable batch and real-time data processing solutions using Apache Spark (Core, SQL, Streaming), Scala, PySpark, Hadoop, and Hive.
Build and maintain enterprise-grade ETL/ELT pipelines across cloud platforms including AWS, Azure, and Google Cloud Platform (GCP).
Develop high-performance data ingestion frameworks using Kafka, Snowpipe, Dataflow, Dataproc, Azure Data Factory, and AWS Glue.
Design and optimize large-scale data warehouses and ELT solutions using Snowflake, including Streams, Tasks, Clustering, RBAC, and semi-structured data processing.
Implement scalable data solutions on Hadoop ecosystems including HDFS, MapReduce, YARN, Hive, HBase, and Cloudera (CDH).
Convert complex SQL and Hive workloads into optimized Spark transformations using RDDs, DataFrames, and Spark SQL.
Develop and manage real-time streaming data pipelines using Kafka, Spark Streaming, and event-driven architectures.
Design and optimize distributed data systems on Databricks, EMR, Dataproc, Cassandra, HBase, Elasticsearch, and other NoSQL platforms.
Build robust workflow orchestration solutions using Airflow, Control-M, Autosys, Oozie, ADF, and Cron scheduling tools.
Create and integrate RESTful APIs and microservices using Java, Spring Boot, and distributed system design principles.
Perform Spark, Snowflake, and Hadoop performance tuning to improve scalability, reliability, and operational efficiency.
Design and implement secure data governance, data quality, and compliance controls for sensitive financial and customer data.
Develop automation frameworks, monitoring solutions, and testing utilities using Python, Shell scripting, JUnit, ANT, and related tools.
Collaborate with business stakeholders, architects, analysts, and cross-functional teams to deliver enterprise data and analytics solutions.
Provide production support, troubleshooting, cluster management, and continuous improvement for mission-critical big data platforms and cloud-native data ecosystems.
Mandatory Skills: Solution Architecture .
Experience: 3-5 Years .
The expected compensation for this role ranges from CAD 70/hr to CAD 85/hr .
