We have an exciting opportunity for a full-time
Data Engineer to join our IT team in
Langley, BC. Reporting to the Manager, Data & Analytics, you will be responsible for working with one of the largest, most comprehensive datasets in Canada while delivering and pioneering solutions that will disrupt the retail industry using the latest tools and technologies.
You will be responsible for:- Designing and constructing high-performance, scalable data pipelines to operationalize our state-of-the-art solutions ranging from quantum computing pipelines to deep learning based recommender systems
- Creating innovative solutions to tackle computationally intensive challenges and business issues
- Writing production Python/Scala scripts in a Spark/Databricks environment to support the data pipelines that feed Machine Learning models
- Leveraging cloud environments and following best practices while building solutions in the data lake as it evolves to meet the needs of the business
- Performing data wrangling, feature engineering, and dimension reduction with data of all shapes and sizes, from parquet files to images
- Partnering with Machine Learning Engineers, Data Scientists, and Cloud Architects to deliver models into production
- Coaching, mentoring, and providing feedback to team members and junior data engineers
- Discovering novel datasets and data sources and making them available for modeling and reporting
- Using your expertise in big data technologies to champion innovation, design, and implement data-stores and analytic models, oversee large-scale data lake platforms, and design and implement efficient data pipelines from source systems to data-stores
- Defining and implementing Quality Assurance best practices that support the implementation of data transformations and the availability of high-quality data.
You have:- A Bachelor's degree in a STEM discipline at minimum, a Master's is preferred.
- A minimum 2 years of experience in creating and managing large-scale, distributed data
- Expertise in Python and Spark. Experience in other programming languages such as Java, Scala, or C++ is a plus
- Expertise in SQL
- Experience designing and deploying high-performance data processing systems with reliable data validation, monitoring, and logging practices
- Rigor in high code quality, automated testing, and other engineering best practices
- Experience with big data technologies such as Hadoop, Spark and Databricks
- Familiarity with software development best practices, including version control, CI/CD and CAB processes
- Expert knowledge of databases and modern data workloads
You are:- A strong communicator
- Detail-oriented and organized
- A leader with an ownership mindset
- Passionate about machine learning
- Able to work independently and as part of a team
What we offerIn addition to
a highly competitive salary, we offer a great range of
benefits, a
company pension plan, free parking, exclusive team member offers, and opportunities for development and career progression.If you're looking to join a team that puts people first, you're in the right place. Apply online today!
IND6
Compensation Details:$85,062.00 - $106,328.00
The compensation offered for this position will take into consideration location, education, skills, experience and other factors.
