The Data Engineer will work primarily within our Microsoft data ecosystem, designing pipelines, transforming large datasets, troubleshooting production issues, and partnering with business and technology teams to make data useful and accessible across the organization. This role is responsible for building and supporting reliable data solutions that make accurate, timely, and trusted data available for reporting, analytics, operational processes, and emerging AI capabilities.
Key Responsibilities
- Design, build, and support scalable ETL/ELT pipelines that integrate data from databases, APIs, business applications, files, and other internal and external sources.
- Develop and optimize SQL, Python, and PySpark solutions to transform large datasets and make reliable data available for reporting and analytics.
- Build and maintain data warehouses, data lakes, dimensional models, and related data structures within Microsoft Fabric and other enterprise data platforms.
- Monitor and troubleshoot production data issues, including pipeline failures, unavailable data, processing delays, and performance bottlenecks, and implement long-term solutions.
- Partner with analysts, business stakeholders, architects, and technology teams to understand requirements and deliver secure, maintainable data solutions.
- Participate in technical discussions, peer reviews, documentation, and continuous improvement efforts, including opportunities to responsibly use AI and automation.
Qualifications
- 5+ years of experience in data engineering, data integration, analytics engineering, or a related field.
- Bachelor's degree in a computer-related field or equivalent relevant experience.
- Strong experience with SQL and Python/PySpark, including building and optimizing production data pipelines.
- Experience with Spark and cloud data platforms such as Microsoft Azure, AWS, or Google Cloud.
- Strong knowledge of ETL/ELT, data warehouses and lakes, data modeling, data quality, and production support.
- Strong analytical and problem-solving skills with the ability to troubleshoot complex data and pipeline issues and communicate effectively with technical and business stakeholders.
- Experience building and optimizing pipelines that process large-scale datasets, including millions of records.
- Experience with Microsoft Fabric, Azure Data Factory, Azure Synapse Analytics, Databricks, or similar modern data platforms preferred.
- Experience with Scala, NoSQL technologies, AI-assisted development, or AI-enabled data solutions preferred.
Additional Information:This is a fully on-site position reporting to the Columbus, Ohio office Monday through Friday.
This salary range for this position is between $105,000-$130,000.
We offer a benefits package that includes health, dental and vision insurance, company sponsored life, optional life and disability insurance, Health Savings Accounts and Flexible Spending Accounts, a 401(k) plus match, Tuition Assistance, Paid Parental Leave, Paid Time Off (PTO), a Dress for your Day dress code and paid holidays.