Role : Assistant Vice President - Data Engineer

JD :

Data Engineering, Data Architecture, and ETL
• Designing, building, and maintaining scalable and efficient data pipelines to extract, transform, and load (ETL) data from various sources into Enterprise Data Platform (EDP).
• Designing and implementing data marts, including dimensional modeling, schema design, and optimization techniques.
• Integrating and consolidating data from diverse sources, such as databases, sftp's, APIs, and streaming platforms, ensuring data quality, consistency, and integrity.
• Creating and maintaining data models, defining data structures, relationships, and data storage requirements, using techniques like entity-relationship diagrams and data flow diagrams.
• Developing data transformation processes, including data cleansing, normalization, aggregation, and enrichment, to prepare data for analytics and reporting.
• Identifying and resolving performance bottlenecks in data processing and storage systems, optimizing query performance, and improving overall data pipeline efficiency.
• Implementing data quality assurance processes, performing data validation, testing data pipelines, and resolving data quality issues.
• Monitoring data pipelines, diagnosing and troubleshooting issues, performing system upgrades and maintenance tasks to ensure data reliability and availability.
• Collaborating with cross-functional teams, including Business Liaisons, analysts, and software engineers, and documenting data engineering processes, workflows, and best practices.

Supports training of team members on how to properly organize findings and read data collected.
• Partners with Technology Infrastructure and Support Operations team to identify, design, and implement internal process improvements: e.g., automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalability.
• Partners with Technology Infrastructure and Support Operations teams to build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Microsoft Fabric.
• Understands how data platform integrates within the overall technical architecture.