We are seeking an experienced and motivated Senior Data Engineer to join our Data & Business Intelligence team. This key and critical role will report directly to our Vice President, Data & Business Intelligence. The ideal candidate will have deep, hands-on expertise across the core Microsoft data platform & ecosystem with demonstrated ability to design and deliver end-to-end solutions and will possess a meaningful working knowledge of Oracle Cloud Infrastructure and Oracle enterprise applications, with particular emphasis on data integration patterns.
What You Will Do:- Design, build and maintain scalable, reliable data pipelines that ingest, transform and serve data from ERP, MES, WMS, IoT and third-party systems.
- Lead architecture decisions for the enterprise data lakehouse, establishing standards for data modeling, pipeline patterns and platform governance.
- Collaborate with business stakeholders in manufacturing operations, supply chain, finance and executive leadership to translate requirements into technical solutions.
- Optimize data platform performance, cost and reliability across Microsoft Fabric, Azure and SQL Server environments.
- Ensure data quality, lineage and observability through automated testing, monitoring and alerting.
- Mentor junior and mid-level data engineers; conduct code reviews and enforce engineering best practices.
- Partner with the Oracle Applications team to maintain and evolve integration patterns between Oracle ERP/OCI and the Azure/Fabric data platform.
- Support regulatory and audit requirements related to data retention, access controls, and traceability.
- Partner with the Oracle Applications team to maintain and evolve integration patterns between Oracle ERP/OCI and the Azure/Fabric data platform.
- Support regulatory and audit requirements related to data retention, access controls and traceability.
What You Will Bring:- Bachelor's degree in Computer Science, Engineering or a related technical field.
- Minimum of 12 years of experience, including knowledge of and experience with the following:
- Microsoft Data Platform - Microsoft Fabric
- Architect and implement lakehouses, warehouses and data pipelines within Microsoft Fabric.
- Design medallion (Bronze/Silver/Gold) architectures in OneLake.
- Build and manage Fabric Data Factory pipelines and Dataflows Gen2.
- Develop real-time intelligence solutions using Eventstream and KQL databases.
- Configure workspaces, capacity management and governance policies.
- Integrate Power BI semantic models within Fabric for self-service analytics.
- Azure Data Services
- Design and implement solutions using Azure Data Lake Storage Gen2, Azure Data Factory, Azure Synapse Analytics and Azure Databricks.
- Develop and optimize Spark-based transformation workloads.
- Implement Azure Event Hubs and Stream Analytics for real-time data ingestion.
- SQL Server
- Design and tune complex queries, stored procedures and functions.
- Implement partitioning, indexing strategies and query plan optimization.
- Manage SQL Server Always On availability groups and replication.
- Oracle ERP / Cloud Applications Integration
- Experience with Oracle Cloud Infrastructure (OCI) Data Integration, OCI Data Flow (Apache Spark) and Autonomous Data Warehouse (ADW).
- Familiarity with OCI Object Storage and GoldenGate for real-time data replication.
- Understanding of Oracle ERP Cloud (Oracle Fusion) data models, including Financials, Procurement and Supply Chain modules.
- Experience extracting data from Oracle ERP using BIP (Business Intelligence Publisher) reports, OTBI or direct OTBI-Enterprise extracts.
- Familiarity with Oracle Integration Cloud (OIC) for application-to-application and B2B integration.
- Cross-Platform Integration Patterns.
- Design and implement hybrid integration architectures bridging Oracle and Microsoft ecosystems.
- Knowledge of data synchronization strategies between Oracle and Azure/Fabric environments.
- Manufacturing & Distribution/Supply Chain domain experience. Deep familiarity with the data and operational contexts of industrial environments is strongly preferred:
- Manufacturing
- OEE (Overall Equipment Effectiveness) analytics and shop floor data integration.
- MES (Manufacturing Execution System) and SCADA data pipelines.
- Bill of Materials (BOM), work orders and production scheduling data models.
- Quality management, SPC (Statistical Process Control) and defect tracking.
- IoT sensor data ingestion, time-series analysis and predictive maintenance.
- Distribution & Supply Chain
- Warehouse Management System (WMS) integration and inventory analytics.
- Transportation Management System (TMS) data and freight analytics.
- Demand forecasting, replenishment and S&OP data pipelines.
Nice To Have:- Microsoft Certified: Azure Data Engineer Associate.
- Microsoft Fabric Analytics Engineer certification.
- Exposure to real-time streaming with Kafka or Azure Event Hubs.
- Experience with Lean/Six Sigma operational data in manufacturing.
- Familiarity with Python or PySpark for complex transformations.
- Background in ERP implementations (Oracle, SAP or similar).
Benefits of Working at Darigold:We understand that as an employee, benefits that support you and your family in and out of work are important. We're proud to offer eligible positions a competitive total rewards package that includes:
- 401k competitive employer matching
- Comprehensive medical, dental & vision benefits
- Employer paid life & disability coverage
- Paid time off and paid holidays
- 8 weeks paid parental leave
- Education assistance
- Employee assistance program
- Flexible hybrid working arrangement where it applies (up to 1 day/week after initial 90 days and approval by hiring manager and HR)
- Compensation range: $143,077.55 - $214,616.33 (individual wage based on previous experience, knowledge, and skills)
Our Commitment to Diversity:Achieving our vision to Lead Dairy Forward requires cultivating and supporting a team with varying backgrounds, experiences, and perspectives. We are committed to providing a workplace based on mutual respect where all employees feel included and can bring their best and authentic selves to work every day.
