What we needExol is seeking a Senior Data Engineer to join our Data Platform team within our IT organization. Your job will be to design, build, and scale a cloud-native, multi-tenant data platform that delivers reusable data services, pipelines, and platform capabilities for analytics, customer products, and AI-driven solutions.
What we doExol is pioneering Warehousing-as-a-Service by delivering outsourced and automated warehouse operations for wholesale, retail, and general merchandising industries. Our Data Platform team develops the shared cloud infrastructure, data services, and engineering capabilities that support multiple customers and products.
What you'll do- Design and enhance a scalable, cloud-native, multi-tenant data platform.
- Build and optimize batch and streaming data pipelines, transformation models, and reusable data services.
- Develop scalable data models using BigQuery and dbt while implementing data quality, governance, lineage, and monitoring practices.
- Create Infrastructure as Code using Terraform and maintain CI/CD pipelines using GitHub Actions or similar tools.
- Implement automated testing, deployment, release, observability, logging, and alerting capabilities.
- Monitor platform health, troubleshoot production issues, and drive improvements in scalability, reliability, and operational performance.
- Partner with Product, Engineering, AI, and Analytics teams while contributing to architecture reviews, technical documentation, engineering standards, and team mentorship.
What you'll need- Minimum of 5 years of related experience or equivalent work experience
- Bachelor's degree in computer science, Engineering, Information Systems, or a related field.
- Experience designing and building cloud-native data solutions using Google Cloud Platform, BigQuery, and dbt.
- Strong SQL and Python skills, with experience working with PostgreSQL or other relational databases.
- Experience developing scalable batch and streaming data pipelines using Apache Airflow or Cloud Composer.
- Experience implementing Infrastructure as Code with Terraform and building CI/CD pipelines.
- Experience with technologies such as Pub/Sub, Datastream, Dataflow, Cloud Storage, Cloud Functions, Cloud Run, Kubernetes, or Docker.
Our Environment- Up to 10% of travel may be required. Employees must have a valid driver's license and the ability to drive and/or fly to client locations and company HQ.
- Employees may be required to use a personal credit card for business travel expenses, which are reimbursed based on the program guidelines. Eligible employees may receive a corporate credit card based on role and travel requirements, but a personal credit card may be needed during onboarding until the corporate card is issued.
#LI-JH4
#LI-Remote
