5+ years in Life Sciences building data pipelines for LIMS (Laboratory Information Management System).
5+ years in data integration and warehousing, preferably with Snowflake Cloud.
5+ years with relational databases (SQL Server, MySQL, Oracle, etc.).
5+ years using ETL/ELT tools like Fivetran, Talend, Matillion, or Apache Airflow.
3+ years with custom ETL/ELT and programming languages (Python required).
Experience developing dynamic data pipeline frameworks with relevant tools.
Current experience in Cloud environments (AWS, Azure, GCP).
Responsibilities
Drive the design and build of a scalable data pipeline framework for Snowflake Cloud.
Model data for scalability and optimized performance.
Collaborate with business users to identify needs and problems.
Work with BI developers, Data Scientists, and other stakeholders to implement solutions.
Produce detailed documentation of data pipeline designs and behaviors.
Participate in evolving data engineering patterns and defining best practices.
Apply data quality techniques and implement Role-Based Access Security (RBAC).
Contribute positively to team dynamics and learn the business context.
Benefits
Collaborative work environment with cross-functional teams.
Opportunities for professional development and learning.
Engagement in innovative data solutions.
Involvement in architectural evolution of data systems.
Full Job Description
About the Job
The successful candidate will be a strong leader with the ability to execute specialized modern data solutions in the Snowflake Cloud data warehouse. They will possess skills in design, development, implementation, documentation, and management of data solutions, and be expected to clearly articulate and present technical information to clients and stakeholders.
Responsibilities:
Drive the design, building a metadata driven generic and scalable data pipeline framework for the Snowflake Cloud Data Warehouse;
Understanding of how to model data for scalability and optimized performance.
Collaborate with business users to understand the need / problem.
Collaborate with BI developers, Data Scientists, Product Managers, Software Engineers, Data Modelers and/or Platform owners to define the scope, design and implement the correct solution.
Produces detailed and high-quality documentation detailing design and behaviors of data pipelines.
Participate in architectural evolution of data engineering patterns, frameworks, systems, and platforms including defining best practices, standards, principles, and policies.
Working knowledge of data quality approaches and techniques.
Familiarity implementing Role Base Access Security (RBAC) for sensitive data.
Bring a positive energy every day and work within a team to deliver the best possible solutions.
Learn the business and the data that supports the business.
Required Qualifications:
5+ years experience in Life Science business in building data pipelines for LIMS (Laboratory Information Management System).
5+ years experience in data integration and data warehousing (preferably Snowflake Cloud data warehouse).
5+ years experience with relational database technologies (SQL Server, MySQL, Oracle, or similar).
5+ years experience with ETL/ELT tools such as Fivetran, Talend, Matillion, Apache Airflow or similar.
3+ years experience Experience with custom ETL/ELT and programming/scripting language experience: Pyspark, Python, Scala (Python required).
Experience with developing dynamic data pipeline frameworks (with Fivetran, Talend, Matillion, Apache Airflow or similar).
Current experience with developing on Cloud Environments (AWS, Azure, GCP for instance).
Experience working in an Agile team and delivery capability.
Experience performance tuning and optimization.
BS Degree or MS Degree in Computer Science or equivalent area of study is required.