Job Summary

This position is responsible for managing the day-to-day execution of data ingestion and integration workflows that support the organization's data platforms and analytics products. This role oversees a team of data engineers and integration specialists, ensures the reliability and quality of data pipelines, and supports the delivery of data products to internal teams and external clients.

Working primarily with Azure Data Factory, Azure Databricks, and SQL-based systems, this person focuses on operational execution, process consistency, and team coordination while partnering with senior data leadership on architecture and long-term platform direction.

Responsibilities

Data Integrations & Operations

- Oversee the ingestion and integration of multiple data sources into the lakehouse environment

- Coordinate and maintain data pipelines using Azure Data Factory and Databricks Lakeflow Jobs

- Monitor pipeline execution, troubleshoot issues, and escalate complex problems as needed

- Ensure data quality, consistency, and auditability across integrated datasets

Process & Standards

- Apply established data integration standards, documentation practices, and coding guidelines

- Support the implementation of data governance, security, and compliance requirements within pipelines

- Identify operational improvements to AB/EV, voter file, and consumer data workflows

Delivery & Coordination

- Ensure timely delivery of data products to cloud storage, data marts, and third-party platforms

- Coordinate with data engineering, analytics, and operations teams to align schedules and dependencies

- Provide regular status updates and technical explanations to managers and stakeholders

Team Leadership

- Lead and support members of the data integration team, including performance reviews, goal setting, and professional development

- Assist with interviewing, onboarding, and training new team members

- Provide ongoing guidance and feedback to ensure consistent execution and quality

Additional Support

- Participate in code reviews and provide technical input on data engineering tasks

- Assist with ad hoc data projects and priority requests from leadership

- Support off-hours or weekend work during peak processing periods as required

Required Skills

- Experience with Databricks or other Apache Spark-based platforms

- Proficiency with Azure Data Factory or comparable orchestration tools

- Working knowledge of Python, Scala, or similar data engineering languages

- Understanding of lakehouse architecture and data modeling concepts

- Familiarity with CI/CD and DevOps practices in a data environment

- Strong organizational skills and ability to manage multiple priorities

- Clear written and verbal communication skills for technical and non-technical audiences

Required Qualifications

- Bachelor's degree in data science, statistics, computer science, political science, or a related field

- 3+ years of experience with Databricks or Spark-based platforms

- 3+ years of SQL experience

- 2+ years of experience with Azure Data Factory or a similar orchestration tool

- Prior experience mentoring or leading technical staff

- Familiarity with political, election, or campaign data preferred