Job Description
The Data/DataOps Engineer II is a junior-to-mid level position that will provide data pipeline, orchestration, and platform operations expertise to guide the development, deployment, and reliable operation of data products and reporting solutions within the Verisk Claims Solutions division. The successful candidate has experience developing data pipelines using cloud services, designing data structures that support data products and reporting systems, and applying DevOps/CI-CD practices to keep those systems secure, observable, and repeatable to operate. In this hands-on role, he/she will be responsible for collaborating with product owners, tackling technical problems, helping define best practices, and contributing in design/code reviews. In addition, the candidate will help create innovative solutions to satisfy the growing needs of internal and external customers.
Responsibilities
• Pipeline Development - Design and develop data pipelines using cloud serverless/container services (e.g., managed functions, batch compute, container orchestration, and workflow/orchestration frameworks) in conjunction with cloud data warehousing platforms.
• Data Table Design - Design, review, and build dimensional/Kimball style data models for data products and business intelligence reporting systems.
• Platform Operations & DevOps - Build and maintain CI/CD pipelines and deployment automation for data pipelines and infrastructure, following version-controlled, repeatable release practices.
• Access & Governance Operations - Support access provisioning/lifecycle management, role-based permissions, and audit/compliance controls across data platforms in line with security and governance standards.
• Integration - Build and consume REST APIs and integrate with web services/gateways as part of pipeline or platform automation.
• Collaboration - Work closely with product owners to understand and refine new feature requests. Work closely with data engineering team to design, review, and develop new data pipelines.
• Communication - Ability to communicate technical ideas in terms product owners and non-technical users can understand.
• Best Practice - Ensure standard practices are followed for logging, monitoring, alerting, incident response, and data security.
• Data Security - Understand Verisk data security policies and controls and design and implement ways to comply with the policies.
Qualifications
About You and How You Can Excel in This Role
• BS or MS degree in Computer Science, Information Technology, or related field.
• 2+ years of experience designing and developing cloud data pipelines (ETL/ELT solutions).
• 2+ years of Data Warehousing experience.
• Proficient in writing SQL for aggregating and transforming data as part of a data pipeline.
• Experience using Python for automating processes, working with APIs, and/or transforming data.
• Working knowledge of dimensional/data modeling methods used to support business intelligence tools.
• Experience building data pipelines using a variety of data sources (RDBMs, NoSQL, REST APIs, message queues, and files).
• Experience working with a cloud data warehouse platform (e.g., Snowflake or equivalent).
• Experience with cloud serverless/container technologies (e.g., functions-as-a-service, managed batch compute, container orchestration) and workflow orchestration frameworks.
• Working knowledge of DevOps fundamentals and CI/CD practices (build/release pipelines, infrastructure-as-code, automated deployments).
• Experience with access management, security, and governance/audit operations on a data platform.
• A curious, inquisitive mindset with the ability to learn new technologies quickly and troubleshoot through ambiguous issues.
• Working knowledge of development standards/best practices with the ability to follow established design patterns.
• Proficiency with version control systems (GIT)
• Proficiency with database modeling tools (SqlDBM, etc.)
• Experience with REST APIs, API gateways, or other web application/integration technologies is a plus.
• Experience working with tokenized PII is a plus.
• Insurance industry experience is a plus.
#LI-LM03
#LI-Hybrid
