Senior Data Engineer - Data Governance & DataOps

Pattison Food Group

$108K — $135K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Undergraduate or master’s degree in computer science/engineering or equivalent experience in a large retail organization.
  • 7+ years in data engineering or analytics engineering with recent lakehouse tech experience (Databricks/Delta preferred).
  • Strong SQL and Python skills; hands-on experience with Spark (PySpark) and Databricks workflows.
  • Experience with governance platforms like Microsoft Purview or Unity Catalog.
  • Proficient in data modeling, performance tuning, and reusable pipeline frameworks.
  • Experience implementing data quality as code using testing frameworks like Great Expectations or Deequ.
  • Strong familiarity with semantic models and Power BI design.

Responsibilities

  • Design and implement an end-to-end data quality framework across enterprise data sources.
  • Build reusable data quality models, dashboards, and scorecards to surface issues to business teams.
  • Establish and evolve standards for data observability, contracts, and governance automation.
  • Analyze data to identify quality issues, quantify business impact, and recommend actionable fixes.
  • Lead architecture and development of scalable data pipelines using Databricks and Delta Lake.
  • Collaborate with cross-functional teams to ensure solutions align with data domain needs.
  • Mentor junior team members and contribute to best practices in CI/CD, version control, and testing.

Benefits

  • Comprehensive benefits package.
  • Company pension plan.
  • Free parking available.
  • Exclusive offers for team members.
  • Opportunities for development and career progression.
Full Job Description

We have an exciting opportunity for a full-time Senior Data Engineer – Data Governance & DataOps to join our IT team in Langley, BC.

Reporting to the Director, Enterprise Architecture, you’ll be the technical lead responsible for designing, implementing, and operationalizing enterprise-wide data quality measurement and monitoring. This role sits at the intersection of data engineering, governance, and analytics, with hands on ownership of frameworks, pipelines, and standards across Databricks, Delta Lake, Power BI, and Informatica.

In this role you will work closely with a Business Analyst, Product Owner, and rotating Business Data Stewards to define data quality expectations, build reusable frameworks, and surface trustworthy insights for business partners. If you enjoy improving reliability, reducing chaos, and building scalable solutions that move business outcomes.


You will be responsible for:

  • Designing and implementing an end-to-end data quality framework across enterprise data sources, including rules, measures, monitoring, and automated detection.

  • Building reusable data quality results models, Power BI dashboards, and scorecards that clearly surface issues to business teams and drive measurable improvements.

  • Establishing and evolving standards for rules as code, data observability, data contracts, and governance automation.

  • Performing targeted data analysis to identify data quality issues, quantify business impact, and recommend actionable fixes that improve reliability and operational outcomes.

  • Leading the architecture and development of scalable data pipelines using Databricks, Delta Lake, and modern lakehouse patterns.

  • Partnering with cross functional engineering and business teams to ensure solutions are robust, performant, and aligned with data domain needs.

  • Mentoring junior technical team members and contributing to define best practices for CI/CD, version control, testing, and code quality.

You have:

  • An undergraduate or master’s degree in computer science/engineering, or an equivalent combination of education and experience, preferably in a large and complex retail organization.

  • 7+ years of data engineering or analytics engineering with recent experience using modern lakehouse technologies (Databricks/Delta preferred).

  • Strong SQL and Python; hands on experience with Spark (PySpark) and Databricks Jobs/Workflows.

  • Experience with metadata and governance platforms such as Microsoft Purview or Unity Catalog.

  • Proven experience with data modeling, performance tuning, and reusable pipeline frameworks.

  • Experience implementing data quality as code (e.g., Great Expectations, Databricks Expectations, Deequ, or similar testing frameworks).

  • Experience with semantic models and BI layer design (Power BI strongly preferred).

  • Strong engineering fundamentals: version control, CI/CD, automated testing, release management.

  • You have a clear, concise communication style and can translate complex data and engineering concepts into simple, business‑relevant language for non‑technical stakeholders.

  • Background in retail/grocery or other high volume transactional domains (considered an asset).

  • Experience establishing enterprise data domains and data products (considered an asset).

  • Orchestration experience with tools such as Databricks Workflows, Airflow, Informatica, and ADF/Fabric Data Factory(considered an asset).

You are:

  • Able to translate business needs into technical architecture capabilities.

  • Able to quickly comprehend the functions and capabilities of new technologies.

  • A curious learner who stays informed on emerging technologies and is motivated by long-term results and achieving targeted business outcomes.

  • A proactive relationship builder who creates partnerships and maintains a high level of trust with stakeholders to drive outcomes.

What we offer:

In addition to a highly competitive salary, we offer a great range of benefits, a company pension plan,free parking, exclusive team member offers, and opportunities for development and career progression.

If you’re looking to join a team that puts people first, you’re in the right place. Apply online today!

IND6


Compensation Details:

$108,405.00 - $135,506.00

The compensation offered for this position will take into consideration location, education, skills, experience and other factors.

Similar Jobs

More Jobs at Pattison Food Group

More Information Technology Jobs

Find similar Senior Data Engineer - Data Governance & DataOps jobs: