We are looking for a Senior Data Engineer to lead the development and scaling of our core data infrastructure. You won't just move data; you will be a key contributor in architecting and maintaining our Sources of Truth. Your mission is to transform raw, source data into authoritative, governed data marts by building high-performance pipelines and a robust Semantic Layer that ensures consistency across the entire business.
If you enjoy the challenge of orchestrating complex workflows utilizing Databricks, Fivetran, dbt and Snowflake, and you take pride in ensuring that key metrics are defined once and trusted everywhere, this is the role for you.
What You'll Do- End-to-End Pipeline Engineering: Design, build, and deploy scalable ETL/ELT pipelines from diverse source systems into our Snowflake Data Cloud.
- Cloud Infrastructure: Manage and optimize data flows within an AWS environment (S3, Lambda, IAM), ensuring high availability, security, and cost-efficiency.
- High-Scale Processing: Leverage Databricks and Python (PySpark) to handle complex transformations and high-volume data processing.
- Implement the Semantic Layer: Collaborate with the team to define, implement and scale our Semantic Layer (via dbt Semantic Layer, MetricFlow, or similar) to standardize business logic, metrics, and dimensions for all downstream consumers.
- Model for Truth: Use dbt to build modular, version-controlled, and tested data models that serve as the definitive foundation for business intelligence.
- Data Governance & Quality: Implement automated testing and monitoring to ensure the integrity and reliability of finished data marts.
What you will need to know/have:- Data Warehousing: Expert-level proficiency in Snowflake (clustering, Snowpipe, streams, and tasks) or similar Cloud Data Warehouses.
- Analytics Engineering: Advanced mastery of dbt and complex SQL transformation logic, with specific experience in building Semantic Models and metric definitions.
- Big Data & Code: Strong Python skills and hands-on experience with Databricks for Spark-based orchestration.
- Cloud Infrastructure: Practical experience managing data workloads within AWS.
- Version Control: Deep understanding of Git-based workflows and CI/CD for data.
- A Data Quality Champion: You believe data is a liability until it's governed. You have a passion for data modeling and reducing "metric drift" across the organization.
- Scale-Oriented & Efficient: You design for the long term. You take pride in building streamlined, cohesive data environments that eliminate redundancy and fragmentation. By focusing on modular design and automation, you ensure our infrastructure is never fragile, remaining stable and easy to navigate even as data complexity and volume grow.
A Problem Solver: You find the root cause of data discrepancies and build automated solutions to prevent them from recurring.
Get in on all the awesome at Instructure!We offer competitive, meaningful benefits in every country where we operate. While they vary by location, here's a general idea of what you can expect:
- Competitive compensation, plus all full-time employees participate in our ownership program - because everyone should have a stake in our success.
- Flexible work culture. Our remote, hybrid and in-office collaboration spaces vary by role, team and location.
- Generous time off, including local holidays and our annual "Dim the Lights" period in late December, when teams are encouraged to step back and recharge based on departmental needs.
- Comprehensive wellness programs and mental health support
- Learning and development resources, including professional development tools and tuition reimbursement, to support your growth
- The technology and tools you need to do your best work
- Motivosity employee recognition program
- A culture rooted in inclusivity, support, and meaningful connection
