We are seeking a Senior Data Engineer to transform our data into a scalable, reliable platform that supports analytics, applications, and machine learning. In this role, you will standardize development through GitHub and fully leverage Azure to maximize engineering velocity, improve data quality, and enable future AI and automation capabilities. You will bridge the gap between ML experimentation and production deployment, ensuring our data platform is robust, reliable, and ready for innovation. This is an opportunity to shape how data powers decision-making across the organization.
Key Responsibilities- Deliver production-ready datasets and pipelines to support data science and analytics.
- Bridge the gap between ML experimentation and deployment with MLOps best practices.
- Build and deploy data-driven applications using Azure services.
- Maximize ROI on Azure investment through cloud-native architecture.
- Standardize development workflows using GitHub (version control, pull requests, CI/CD).
- Automate deployments and accelerate engineering velocity with GitHub Actions.
- Reduce bottlenecks for analysts, engineers, and data scientists by improving data accessibility and workflow efficiency.
- Enhance data quality, governance, and observability.
- Enable future capabilities such as AI, automation, and personalization.
Qualifications- 5+ years of experience in data engineering or related roles.
- Proven experience in data engineering, cloud architecture, and MLOps.
- Strong proficiency in Python and SQL for data pipelines, automation, and data framework (Spark, Panda).
- Familiarity with REST APIs and application development concepts.
- Strong knowledge of Azure services (Data Factory, Synapse, Databricks, etc.) and cloud-native solutions.
- Proficiency with GitHub, including version control, CI/CD, and automation using GitHub Actions, workflows, and PR reviews.
- Experience delivering production-ready datasets and pipelines for analytics and ML.
- Ability to collaborate effectively with data scientists, analysts, and engineers to prepare and deliver clean, feature-ready datasets.
- Knowledge with data governance, observability, and quality best practices is preferred.
- Experience with real-time streaming tools (Kafka, Event Hub) also preferred.
- Strong problem-solving skills and a passion for building scalable, maintainable, and automated data platforms.
- Experience with Microsoft Fabric of Lakehouse architectures is a nice-to-have.
Company Details:- Location: Remote
- This position will report to the VP of AI and Analytics
The pay range for this role is:
150,000 - 170,000 USD per year (Remote)
