Role Overview:This role is for a Data Engineer with an insurance background, focusing on the development and maintenance of robust, automated data pipelines. The engineer will be responsible for designing and creating large-scale, high-performance data architectures, including data lakes and warehouses. Key aspects of the role involve performing ETL/ELT operations to ensure data quality, consistency, and accessibility, as well as optimizing databases, SQL/NoSQL systems, and cloud infrastructure for peak performance. Collaboration with data scientists and analysts is essential to meet data requirements while strictly adhering to data privacy and compliance standards.
Key Responsibilities: - Build, debug, and maintain robust, automated data pipelines to ingest data from various sources.
- Design, create, and maintain large-scale, high-performance data architectures (data lakes, warehouses).
- Perform data transformation and cleaning to ensure data quality, consistency, and accessibility.
- Monitor and tune databases, SQL/NoSQL systems, and cloud infrastructure for performance.
- Work with data scientists and analysts to meet data requirements, while ensuring data privacy and compliance.
Required Skills: Qualifications: Preferred Skills: