Azure Data Engineer (Databricks)

Project X

$86K — $125K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 2+ years of hands-on experience in data engineering focusing on Python development.
  • Proven experience with DBT for data transformation and modeling.
  • Familiarity with ETL development using tools like Matillion or DPC.
  • Strong SQL skills to work with structured and semi-structured data.
  • Knowledge of cloud data platforms, including Snowflake, Azure, or AWS.
  • Understanding of data quality practices and error handling strategies.
  • Experience with version control, like Git.

Responsibilities

  • Develop, deploy, and maintain data pipelines using Python and relevant tools.
  • Collaborate with data architects and analysts to meet data integration needs.
  • Translate mapping documents into production-ready workflows.
  • Implement quality checks to ensure data integrity and handle errors.
  • Apply tiered architecture design patterns to pipeline development.
  • Create and maintain metadata for visibility and traceability.
  • Engage in Agile processes including sprint planning and reviews.

Benefits

  • Hybrid working model requiring 3 days in-office attendance.
  • Opportunity to work with large-scale data solutions.
  • Exposure to innovative technologies like generative AI tools.
  • Collaborative team environment with dedicated support from data architects and analysts.
Full Job Description
Company: Project X Ltd.
Employment Type: Full Time
Location: Toronto, Ontario (Hybrid working model) 3 Working days in Office
Salary Range: $86,00- 125,000 CAD Annually

Please note: We have two of the same postings as we have two open positions, please only apply to one posting.

Role Summary

We're looking for a passionate and curious Data Engineer with strong DBT and Python skills and solid experience working with large-scale data solutions. You'll play a key role in building high-quality, reusable ETL patterns and automating robust, scalable data pipelines that power analytics and business decision-making. Experience with Matillion ETL or Project X's Data Pipeline Control (DPC) framework is a plus, and exposure to generative AI (GenAI) tools or techniques is considered an asset.

Key Responsibilities
  • Develop, deploy, andmaintaindata pipelines using Python and tools such asMatillionETL or DPC.
  • Collaborate with data architects and analysts to define and meet data integration requirements.
  • Translate mapping documents into production-ready data workflows.
  • Ensure data integrity by implementing quality checks, handling errors, and performing root cause analysis.
  • Apply tiered architecture design patterns (bronze/silver/gold models) to pipeline development.
  • Create ormaintainmetadata and control structures for visibility and traceability.
  • Work with cloud-based data warehouses (e.g., Snowflake, Azure Synapse, Redshift).
  • Participate in Agile processes, including sprint planning and reviews.


What We're Looking For - Required Qualifications
  • 2+ years of hands-on experience in data engineering with a focus on Python-based development.
  • Proven experience using DBT (Data Build Tool) for data transformation and modeling
  • Experience with ETL development (Matillion, DPC, or other orchestration tools).
  • Strong SQL skills and ability to work with structured and semi-structured data.
  • Familiarity with cloud data platforms such as Snowflake, Azure, or AWS.
  • Understanding ofdata quality practices, error handling, and recovery strategies.
  • Ability to interpret mapping documents and accurately implement logic.
  • Experience with version control (e.g., Git) and CI/CD pipelines is a plus.
  • Bonus:Exposure toGenAI, LLMs, or machine learning workflows.


Nice to Have
  • Experience in data modeling, data governance, or metadata frameworks.
  • Knowledge of data observability tools or building monitoring dashboards.
  • Familiarity with orchestration tools like Airflow or transformation tools likedbt.
  • Consulting experience or comfort working in fast-paced, client-facing environments.


Use of Artificial Intelligence in Recruitment

Project X may use automated or AI-enabled tools as part of the recruitment and selection process. These tools may support activities such as resume screening, candidate matching, or application management. All hiring decisions involve human review and judgment.

How to Apply

Please apply with your resume and cover letter.

Similar Jobs

More Jobs at Project X

More Information Technology Jobs

Find similar Azure Data Engineer (Databricks) jobs: