Where you come in:
We are seeking an experienced and adaptable Senior Data Engineer to join our data team in the finance and data warehousing domains. This role involves taking the lead in the ownership, design and delivery of the data pipelines and warehousing infrastructure that feeds analytics and reporting across The Beatport Group.
The ideal candidate will have 5+ years of directly relevant data engineering experience, including experience in building and owning all aspects of cloud data warehouses (marts, lakes, lakehouses, etc.), production data pipelines end to end, handling and prioritising data requests from both technical and non-technical stakeholders, and translating these into robust, maintainable solutions. This is an ownership heavy role, and the successful candidate will be trusted to own critical pipelines, resolve production incidents, and maintain engineering best practices for others in the group to follow.
The role works across the majority of The Beatport Group's constituent business units to support data flow and integrations required for day-to-day operations. This ranges from our modern data platform with BigQuery and dbt, through to legacy ETL orchestrations with tooling such as Pentaho and Jenkins. Some of the work will be in migrating and deprecating legacy solutions.
This role can be remote but applicants must be based in the Pacific Northwest (Canada or the USA) with a valid right to work.
The Technology Group is spread across Canada, USA and Europe. The role offers an exciting opportunity to play a key role in maintaining and optimising our core data infrastructure, enabling genuine proactive data driven decision making across an organisation of passionate music fans.
As a Senior Data Engineer, you will be responsible for:
- Ownership of production data pipelines across our comprehensive GCP based warehousing, from orchestration to reporting, focusing on reliability, performance, cost efficiency, and integrity.
- Writing scalable dbt and BigQuery SQL across multiple business functions to build and maintain robust data models for all elements of The Beatport Group's stack.
- Planning and designing RDBMS and data warehouses, data models, repositories and pipelines with best practices for performance and scalability
- Maintaining and developing integrations with partners of the group with relevant APIs and file based exchange services (SFTP, GCS etc.), including but not limited to streaming fraud detection partners and music suppliers.
- Create and maintain documentation for APIs, data pipelines, data models and data dictionaries
- Being the reliable point of contact for the resolution of load failures or connectivity issues that affect downstream resources.
As a Senior Data Engineer, you will require:
- 5+ years of direct data engineering experience, ideally within an engineering / analytics / BI or similarly data intensive team.
- Expert proficiency in SQL, ideally Google Cloud SQL supported dialects (MySQL / Postgres)
- Proficiency with data transformation tooling such as Data Build Tool (dbt).
- 3+ years of SQL-based programming and access control against RDBMS database systems such as MS SQL Server, MySQL, Postgres or Oracle
- Demonstrable experience building and owning production data pipelines (ETL/ELT), including orchestration, monitoring and incident resolution. Experience with cloud data orchestration products such as Airflow, Composer, Cloud Run, etc.
- Proficiency with a scripting language beyond SQL, Python in particular
- Self-motivated and proactive, with the ability to work independently and prioritise tasks effectively, with a meticulous approach to data integrity, especially where it feeds financial or regulatory reporting.
- Strong communication and interpersonal skills, both technical and non-technical.
Experience with music streaming, music royalties, audio technologies, DBA responsibilities, AI/ML on GCP, interest in DJ culture, or previous roles in the music or financial industries are all great bonuses to bring to the role.
How to apply
Please apply with your resume by clicking the "apply" link
Benefits
The position is within a highly motivated team with a positive working climate, allowing you to express your talent fully. In addition, we offer appropriate remuneration and very good development opportunities within a dynamically growing enterprise. Beyond this, the position provides an intensive integration into the international music scene.
