Overview
he Senior Data Automation Engineer is a senior individual contributor within the Data Engineering team responsible for designing, modernizing, implementing, and supporting enterprise data automation solutions focused on data ingress into and egress from Databricks. This role partners across technology and business functions to deliver scalable integrations, improve data quality, resolve complex production issues, and advance enterprise automation capabilities supporting customer-critical operations.
Responsibilities
- Databricks Integration, Data Ingress & Egress Ownership: Architect data automation solutions; develop ETL/ELT pipelines, notebooks, APIs and frameworks; own customer-critical integrations and enterprise data movement solutions.
- Production Support, Incident Response & Problem Resolution: Lead troubleshooting, root cause analysis, incident resolution, and corrective actions for customer-impacting production issues and pipeline failures.
- Modernization, Testing & Data Quality Engineering: Evaluate legacy code and integrations; execute testing strategies; implement monitoring, reconciliation, alerting, and recovery controls.
- Automation, Engineering Standards & Documentation: Develop reusable automation frameworks; support CI/CD and engineeringstandards; maintain architecture and operational documentation.
- Cross-Functional Partnership & Technical Leadership: Mentor engineers; partner with business stakeholders; communicate risks, tradeoffs, and strategic recommendations.
- Performs other duties as assigned
- Complies with all policies and standards
- The wage range for this position is $105,720.00-$158,580.00 and may vary based on geography as well as relative knowledge, skills, abilities, and experience.
Qualifications
Education• Bachelor's Degree Computer Science, Information Systems, Data Engineering, Software Engineering or related field (required) Experience• 8+ years of progressive experience in data engineering, automation, integration, software development, or related disciplines. (required) and• Experience supporting logistics, transportation, TMS, EDI, customer integrations, cloud platforms, DevOps, and enterprise-scale operational data environments. (required) Knowledge, Skills, and Abilities• Advanced SQL Server • Databricks • ETL/ELT frameworks • APIs • Orchestration tools • Data integration architecture, and source control • CI/CD • Testing methodologies, automation scripting, root-cause analysis, and enterprise data quality practices