Lead Data Engineer

Two Circles

• $100K — $130K *
Vancouver, BC V5K 5J9In-Person
Information Technology
Less than 5 years of experience
Today
Be an Early Applicant
Job Overview by Ladders

Qualifications

  • 5-7 years of experience in data engineering or related field
  • Proficient in building and implementing DBT models
  • Strong knowledge of Amazon Redshift architecture and SQL
  • Experience with version control systems, preferably Git
  • Effective communication skills to articulate technical concepts
  • Ability to thrive in fast-paced environments with attention to detail

Responsibilities

  • Create and maintain data warehouses and ETL processes using DBT models in Redshift
  • Implement and manage DBT projects including macros and documentation
  • Conduct performance tuning for Redshift queries
  • Develop best practices for data modeling and CI/CD pipelines
  • Build robust tests for all models developed

Benefits

  • Flexible working hours
  • Professional development opportunities
  • Collaborative team environment
  • Access to the latest technologies
  • Focus on work-life balance
Full Job Description
Responsibilities:

*Redshift Experience is essential for this role

*Experience working with Big Data Essential

  • Create and maintain data warehouses and associated ETL processes using DBT models in Redshift
  • Implement and maintain DBT projects, including creating macros, tests, and documentation for data pipelines.
  • Conduct performance tuning for Redshift queries and DBT models to optimize resource utilization.
  • Develop and enforce best practices for data modelling with big data sets, version control, and CI/CD pipelines.
  • Ensure high quality development by building robust tests into each model developed.

Requirements

The ideal background and skills we are looking for include:
  • Hands-on experience designing and implementing DBT models, tests, and documentation in a data warehousing environment.
  • Strong knowledge of Amazon Redshift architecture, SQL, and performance optimization techniques.
  • Familiarity with version control systems like Git and CI/CD workflows
  • Excellent communication skills with an ability to clearly articulate both end user value and technical implementation..
  • Passion for technology and an eagerness to learn
  • Ability to work in a fast-paced, constantly-changing environment while maintaining a strong eye for detail


Experience with the following would also be beneficial:
  • AWS technologies such as Step function, AWS Glue jobs & Data Catalogues, Lambda Functions (Python based) and Athena.
  • Experience in development using Python and Pyspark
  • Experience of, or a keen interest in, the business of sport


* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at Two Circles

More Information Technology Jobs

Find similar Lead Data Engineer jobs:

NationwideVancouver, BC