Senior Fabric Data Engineer

Spirit Omega Inc

$110K — $130K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 7+ years of experience in data engineering and enterprise data integration.
  • Strong hands-on experience with Microsoft Fabric and Azure data services.
  • Expertise in PySpark, SparkSQL, Python, and SQL/T-SQL.
  • Proven ability to build ingestion and transformation pipelines from various sources.
  • Experience with curated data layers, data modeling, and analytics-ready datasets.
  • Familiarity with security protocols, access controls, and data governance practices.
  • Knowledge of Azure DevOps and Git for deployment automation.

Responsibilities

  • Design and implement robust data solutions using Microsoft Fabric.
  • Build scalable ingestion and transformation pipelines utilizing PySpark, Python, and SQL.
  • Migrate and harmonize data from legacy systems like Saba and Cura.
  • Develop API-driven workflows for data ingestion and processing.
  • Implement business rules for learner profiles and compliance tracking.
  • Create curated datasets for analytics and operational reporting.
  • Enforce secure access controls and data governance standards.

Benefits

  • 100% remote work opportunity.
  • Engagement in a fast-paced, innovative delivery environment.
  • Opportunities for professional development and skill enhancement.
  • Cross-functional collaboration in an agile team setting.
Full Job Description
Job Location: Toronto, ON (100% remote)

Work Hours: 40 hrs/wk

Job Summary

We are seeking a Senior Fabric Data Engineer with strong hands-on Microsoft Fabric experience to support migration and modernization of learning-platform data from Saba and Cura into the Cornerstone Galaxy ecosystem. This role will focus on building scalable ingestion, transformation, business-rule, and curated data layers to enable analytics, compliance reporting, skills insights, and downstream integrations.

Work You'll Do
• Design and implement robust data solutions using Microsoft Fabric, including OneLake, Fabric Pipelines, Lakehouse, Warehouse, and Notebooks.
• Build and optimize scalable ingestion and transformation pipelines using PySpark, Python, and SQL across structured and unstructured datasets.
• Migrate and harmonize data from legacy source systems including Saba, Cura, and related enterprise platforms.
• Develop API-driven and scheduled workflows to ingest data from internal and external systems and support downstream processing.
• Implement business rules for learning history, completion status, certifications, compliance, skills, and learner profile data.
• Build curated and consumption-ready datasets/models for analytics, dashboards, and operational reporting.
• Perform SQL development and tuning for reporting, analytics, and downstream consumption.
• Implement automated data quality checks, reconciliations, monitoring, exception handling, and audit logging.
• Enforce secure access controls using Azure AD, RBAC, managed identities, and secure connectivity patterns.
• Support CI/CD, code promotion, release management, and operational monitoring in Agile delivery.

Requirements
• 7+ years of experience in data engineering and enterprise data integration.
• Strong hands-on experience with Microsoft Fabric and related Azure data services.
• Strong experience with PySpark, SparkSQL, Python, and SQL/T-SQL.
• Experience building ingestion and transformation pipelines from APIs, files, databases, and third-party platforms.
• Experience with curated data layers, data modeling, and analytics-ready datasets.
• Experience tuning data pipelines for scale, resiliency, and cost optimization.
• Working knowledge of security, access controls, and data governance practices.
• Experience with Azure DevOps and Git-based deployment automation.
• Strong analytical, troubleshooting, and communication skills.

Preferred Skills
• Experience with learning, HR, or talent data domains.
• Familiarity with ADF, Synapse, Databricks, Azure Functions, or Logic Apps.
• Exposure to AI tools such as GitHub Copilot and Claude to accelerate engineering productivity and solution design.
• Experience with data governance tooling such as Purview.
• Exposure to AI/ML-ready data preparation and feature engineering practices.

Education
• Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related field.

Work Environment
• Ability to work independently and proactively in a fast-paced delivery environment.
• Comfortable operating in remote or hybrid teams with cross-functional coordination.

Similar Jobs

More Jobs at Spirit Omega Inc

More Information Technology Jobs

Find similar Senior Fabric Data Engineer jobs: