The OpportunityThe
Senior Data Engineer is responsible for designing, building, delivering, and supporting scalable enterprise data products, data pipelines, semantic assets, and consumption-ready datasets on the Microsoft Fabric platform.
This role transforms enterprise data into trusted, reusable, and business-aligned information assets that support analytics, operational intelligence, digital solutions, and AI. The Senior Data Engineer implements established architecture, governance, security, privacy, metadata, and data quality requirements within data engineering solutions and ensures delivered data products are reliable, observable, maintainable, and production ready.
This is a senior individual-contributor role requiring strong hands-on engineering capabilities, technical leadership, and ownership of solutions from design through production support.
Key Responsibilities- Design, build, and optimize scalable data engineering and integration solutions using Microsoft Fabric, OneLake, Delta Lake, Spark, SQL, and related Microsoft technologies across batch, near-real-time, and event-driven workloads.
- Develop and maintain trusted enterprise data products, Lakehouse and Data Warehouse solutions, and reusable datasets that support analytics, reporting, digital solutions, and AI use cases.
- Design data models and semantic assets that standardize business definitions, shared entities, reference data, and transformation logic for consistent consumption across business domains.
- Implement data quality, governance, privacy, security, metadata, lineage, and access controls, including automated validation, reconciliation, and quality gates.
- Establish data observability, monitoring, and reliability practices to ensure pipeline and data-product performance, availability, accuracy, resiliency, and cost efficiency.
- Lead production support and complex troubleshooting, including root-cause analysis, incident resolution, recovery procedures, and preventive improvements for business-critical data solutions.
- Apply DevOps and engineering best practices, including Git, automated testing, CI/CD, code reviews, reusable frameworks, and automation to improve scalability, maintainability, and delivery efficiency.
- Provide technical leadership for modern data and AI solutions, developing AI-ready data assets for RAG, agents, Copilot, and advanced analytics while mentoring engineers, partnering across business and technology teams, and evaluating emerging Microsoft Fabric capabilities.
Minimum Qualifications- Bachelors degree in computer science or related field OR equivalent work experience
- In addition to the education requirements, ten years related experience
- All applicants must be able to complete pre-employment onboarding requirements (if selected) which may include any/all of the following: criminal/civil background check, drug screen, and motor vehicle records search, in compliance with any applicable laws and regulations.
Preferred Qualifications- 8+ years of enterprise data engineering experience, including designing, building, and supporting scalable production data solutions.
- Advanced hands-on proficiency in SQL, Python, and Apache Spark/PySpark for data ingestion, transformation, and processing.
- Hands-on experience with Microsoft Fabric or comparable modern cloud Lakehouse platforms, including Delta Lake and modern data integration patterns.
- Strong experience with data modeling and development of trusted, reusable, consumption-ready data assets or Data Products.
- Production experience implementing data quality, observability, troubleshooting, and root-cause analysis for data pipelines and data products.
- Experience with Git, CI/CD, automated testing, and modern engineering practices, combined with demonstrated technical leadership and the ability to independently own complex solutions.
- Advanced hands-on experience with Microsoft Fabric, including OneLake, Lakehouse, Warehouse, Data Factory, Pipelines, Notebooks, and Spark workloads.
- Experience designing and supporting enterprise Data Products and domain-oriented data architectures.
- Experience building semantic models or reusable semantic assets supporting analytics and AI consumption.
- Experience with Fabric Real-Time Intelligence, Eventstreams, streaming, or event-driven architectures.
- Experience with Microsoft Purview, metadata management, lineage, classification, and enterprise data catalog capabilities.
- Experience with Power BI semantic models or related analytical consumption technologies.
- Familiarity with Azure AI Foundry, Azure OpenAI, RAG, vector search, embeddings, or AI-ready data patterns.
- Experience implementing advanced data observability practices for freshness, completeness, schema drift, volume anomalies, and data reliability.
- Experience working within Data Product, Data Mesh, platform engineering, or domain-oriented operating models.
Work Environment/Physical DemandsHybrid or flexible work options may be offered after the first 90 days of employment based upon manager discretion, job performance and work assignments.
Salary PlanITS: Information Technology Service
Job Grade017