Senior Data Engineer (Microsoft Fabric / Financial Data)

Allstate Insurance Company

$100K — $170K *
US-AnywhereRemote in United States
Finance & Insurance
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years in data engineering, analytics engineering, or related technical field.
  • 1-2 years of experience in Microsoft Fabric or similar cloud platforms.
  • Strong skills in SQL, Python, and/or PySpark for data transformation.
  • Experience building enterprise data solutions and reporting datasets.
  • Background with financial or operational data in complex business environments.
  • Knowledge of ETL/ELT processes and data governance concepts.
  • Effective communication skills for technical and non-technical audiences.

Responsibilities

  • Design, develop, and support data solutions for financial reporting and claims.
  • Maintain data structures, transformation logic, and business rules.
  • Develop data pipelines and reporting datasets using modern programming languages.
  • Collaborate with various business teams to translate requirements into data solutions.
  • Lead user testing to validate implementation and reporting impacts.
  • Automate processes to enhance data quality and operational efficiency.
  • Analyze business challenges and propose data-driven solutions.

Benefits

  • Comprehensive technology setup including laptop and monitors.
  • Monthly internet connectivity reimbursement for remote work.
  • Opportunities for technical guidance and mentoring roles.
  • Participation in key enterprise initiatives leveraging modern data engineering.
Full Job Description
We are seeking a Senior Data Engineering (Microsoft Fabric /Financial Data) to design, develop, and support critical financial and operational data solutions that support reserving, claims, and enterprise decision-making. This role combines hands-on technical development with strong business partnership to ensure data is accurate, scalable, and aligned with financial reporting requirements.

The ideal candidate will have experience building and maintaining complex data solutions using SQL, Python, PySpark, Microsoft Fabric, or similar cloud data platforms. This individual will help automate reconciliations, improve data quality controls, reduce manual processes, and deliver reporting and analytics solutions that strengthen operational effectiveness and reduce business risk.

The Allstate internal job title for this role is Software Engineer Lead Cons.

Key Responsibilities
  • Design, develop, test, deploy, and support enterprise data solutions used for financial reporting, reserving, and claims.
  • Own and maintain critical data structures, transformation logic, business rules, bucketing logic, and controls within claims data.
  • Develop and maintain data pipelines, transformation processes, and reporting datasets using SQL, Python, PySpark, Microsoft Fabric, or similar cloud data platforms.
  • Partner with Actuarial Reserving, Accounting Operations, Product, Claims, Financial Planning and Analysis, and other business teams to understand requirements and translate them into scalable technical solutions.
  • Lead and participate in end-user testing to confirm changes are implemented correctly and downstream reporting impacts are understood before production release.
  • Automate reconciliations, exception monitoring, data quality checks, and control processes to improve consistency, scalability, and accuracy.
  • Analyze complex business and data challenges and recommend solutions that improve reporting, decision-making, and operational efficiency.
  • Review code, design, and testing work to support quality, maintainability, and development best practices.
  • Provide technical guidance, coaching, and knowledge-sharing to peers and less experienced developers.
  • Support production issues, investigate root causes, and implement sustainable solutions that reduce future risk.
  • Identify opportunities to modernize tools, improve data governance, and introduce more efficient development practices.


Essential Qualifications
  • 5 years or more of experience in data engineering, analytics engineering, application development, business intelligence development, or a related technical field. (Or Equivalent)
  • 1-2 years of hands-on Microsoft Fabric experience preferred, including data engineering, data transformation, data warehousing, or analytics capabilities. (Or Equivalent)
  • Equivalent experience with Azure Synapse Analytics, Databricks, Snowflake, Azure Data Factory, Redshift, BigQuery, or similar cloud data platforms will also be considered.
  • Strong experience developing complex data transformation processes using SQL, Python, and/or PySpark.
  • Experience designing, building, and supporting enterprise data pipelines, data models, data structures, and reporting datasets.
  • Experience working with financial, claims, premium, accounting, operational, or other complex business data.
  • Strong understanding of ETL/ELT development, data quality controls, reconciliation processes, and data governance concepts.
  • Experience partnering directly with business stakeholders to gather requirements, clarify priorities, and deliver technical solutions.
  • Strong analytical, troubleshooting, and problem-solving skills.
  • Ability to manage multiple priorities and deliver high-quality solutions in a fast-paced environment.
  • Strong communication skills with the ability to explain technical concepts to both technical and non-technical audiences.


Desirable Qualifications
  • Experience with Microsoft Fabric Data Factory, Lakehouse, Warehouse, Power BI, or related Microsoft analytics capabilities.
  • Experience within property and casualty insurance, financial services, or another highly regulated industry.
  • Knowledge of reserving, claims, premium, financial reporting, accounting, or operational reporting processes.
  • Experience automating reconciliations, exception reporting, data validation, and data quality monitoring.
  • Experience with dashboards, automated reports, or analytics solutions using Power BI or similar reporting tools.
  • Experience with Azure cloud services, DevOps practices, version control, or deployment pipelines.
  • Experience leading technical initiatives or mentoring junior developers.


Why This Role Matters

This role plays an important part in ensuring the accuracy, integrity, and availability of data used for financial reporting, reserving, claims operations, and strategic decision-making. The successful candidate will help improve data controls, reduce manual work, strengthen reporting reliability, and support key enterprise initiatives through modern data engineering solutions.

Experience
• 5 or more years of experience (Preferred)

Supervisory Responsibilities
• This job does not have supervisory duties.

#LI-MF1

Skills
Azure Data Factory, Business Intelligence (BI), Data Engineering, Data Governance, Data Pipelines, Data Quality, Data Solutions, Data Structures, Data Transformation, Data Validation, Data Warehousing (DW), Enterprise Data, Extract Transform Load (ETL), Process Improvements, Python (Programming Language), Relational Data Modeling, Reporting, Structured Query Language (SQL), Technical Requirements

Compensation
Compensation offered for this role is 100,000.00 - 170,500.00 annually and is based on experience and qualifications.

The candidate(s) offered this position will be required to submit to a background investigation.

Allstate provides a comprehensive technology setup, including a laptop, monitors, headset, keyboard, and mouse. Employees eligible to work from home also receive a monthly connectivity reimbursement to help offset internet costs.

When working from home, you must have a dedicated, private workspace free from distractions, along with appropriate desk and seating. Reliable internet is required, with minimum speeds of 50 MB download and 5 MB upload.

Similar Jobs

More Jobs at Allstate Insurance Company

More Finance & Insurance Jobs

Find similar Senior Data Engineer (Microsoft Fabric / Financial Data) jobs: