JOB SUMMARY
The Senior Data Engineer will support a strategic enterprise data transformation initiative focused on centralizing and productizing market data assets. This role will be instrumental in building a new enterprise data repository and data delivery platform as part of a broader domain activation and enterprise data management program. This is a hands-on Data Engineering position focused on designing and developing new data pipelines, integrating market data sources, and enabling an enterprise-grade Microsoft Fabric environment.
Key Responsibilities
Design, build, and maintain scalable data pipelines from EDM platforms into Microsoft Fabric
Build ingesting frameworks for third-party market data feeds
Support direct ingestion of certain data sources into Fabric when EDM is not utilized
Develop and maintain data validation, reconciliation, and quality rules
Create and manage data extracts from EDM platforms
Build and maintain enterprise data layers aligned with Medallion Architecture principles
Integrate, transform, cleanse, and consolidate data from multiple source systems
Develop interfaces and mechanisms for data flow, accessibility, and consumption
Collaborate closely with business analysts, data governance teams, and technical stakeholders throughout the implementation lifecycle
Required Qualifications
Strong Data Engineering experience building data pipelines from the ground up
Experience working with Market Data feeds within: Asset Management, Investment Management, Banking, Financial Services
Hands-on experience with Microsoft Fabric
Experience designing and implementing Medallion Architecture (Bronze, Silver, Gold layers)
Strong SQL skills
Experience integrating data from multiple source systems and preparing data for analytical and operational use
Experience developing scalable ingestion, transformation, and validation processes
Experience working with Enterprise Data Management platforms such as: GoldenSource, Rimes, Bloomberg EDM, Gresham, or other comparable EDM/vendor-based data management solutions
Preferred Qualifications
Microsoft Purview experience
Experience with data governance and data quality frameworks
Metadata management experience
Experience supporting enterprise data repositories and data product initiatives
