RESPONSIBILTIES:
- Lead the design, development, optimization, and maintenance of enterprise-scale ETL/ELT pipelines using Azure Data Factory, Azure Synapse Analytics, and Azure Databricks (DBX).
- Design, develop, and optimize data processing solutions using Databricks, Apache Spark, and Delta Lake.
- Lead the technical design and implementation of complex data engineering initiatives from concept through production deployment.
- Design and maintain dimensional data models that support enterprise analytics and reporting.
- Develop scalable stored procedures, SQL scripts, and data transformation processes capable of handling large volumes of data.
- Ensure data quality through validation, reconciliation, monitoring, auditing, and automated quality checks.
- Troubleshoot and resolve complex production issues while improving platform reliability, scalability, and operational efficiency.
- Optimize SQL workloads, Spark jobs, and ETL/ELT pipelines for performance and cost efficiency.
- Collaborate with Product, Engineering, DBAs, and business stakeholders to translate business requirements into scalable technical solutions.
- Participate in data architecture discussions and contribute to the evolution of ABC's enterprise data platform.
- Provide technical leadership through architecture reviews, code reviews, mentoring, and knowledge sharing across the team.
- Establish and promote engineering best practices, reusable frameworks, coding standards, and operational excellence.
- Maintain technical documentation, deployment processes, and operational runbooks.
- Follow and advocate engineering best practices, including source control, CI/CD, testing, monitoring, and release management.
QUALIFICATIONS:
- 6+ years of experience in data engineering, data warehousing, or ETL/ELT development.
- Advanced SQL development skills, including complex query development, stored procedures, large-scale data transformations, query optimization, and performance tuning.
- Strong experience with Azure Synapse Analytics, Azure Data Factory, Azure Databricks, Apache Spark, and Delta Lake.
- Strong understanding of dimensional modeling, including Kimball methodology, and enterprise data warehouse design principles.
- Experience designing, developing, modernizing, and supporting enterprise-scale ETL/ELT solutions and mission-critical production data platforms.
- Experience with Azure SQL Database and/or SQL Server.
- Strong understanding of data quality, auditing, reconciliation, troubleshooting, and production support.
- Experience with Git-based source control, Azure DevOps, Agile development methodologies, CI/CD, and automated deployment pipelines.
- Demonstrated ability to lead complex technical initiatives and mentor other engineers.
- Strong analytical, problem-solving, and troubleshooting skills.
- Excellent communication and collaboration skills with technical and business stakeholders.
- Experience modernizing legacy data warehouse solutions to cloud-based architectures.
NICE TO HAVE:
- Experience designing and implementing data solutions using Databricks Medallion Architecture (Bronze, Silver, and Gold layers).
Compensation for this role will be determined based on a variety of factors, including relevant experience, qualifications, skills, geographic location, and market considerations. The anticipated compensation range for this position is -
$128,200 - $133,500 CAD- annually. In addition to base compensation, eligible employees may be offered other forms of compensation, such as bonuses, commissions, equity, or other incentive programs, where applicable. Compensation and benefits may vary by location and are subject to applicable legal, business, and market requirements.
WHAT’S IN IT FOR YOU:
- Purpose led company with a Values focused culture – Best Life, One Team, Growth Mindset
- Time Off – with our open PTO policy, we offer flexibility in how and when you take PTO!
- Days of Disconnect – once a quarter, we take a collective breather and enjoy a day off together around the globe. #oneteam
- Parental & Pawternity Leave – we offer leave for when your family grows by two feet or four paws!
- Best Life Perk – we are committed to meeting you wherever you are in your fitness journey with a quarterly reimbursement
- Medical/Dental/Vision coverage
- EAP – we get you help when you need it. Period.
- Premium Calm App – enjoy tranquility with a Calm App subscription for you and up to 4 dependents over the age of 16
- And more! – so many benefits we couldn’t even fit them all here!
#LI-REMOTE
