Data Engineer II (Healthcare Data Systems)

OMNY

$110K — $130K *
Healthcare
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 3-5+ years in Data Engineering, particularly in healthcare pipeline production.
  • Hands-on experience with Google Cloud Platform, especially with CloudSQL and BigQuery.
  • Expertise in BigQuery and Snowflake for data architecture and performance tuning.
  • Proficient in Python and SQL programming.
  • Familiarity with Argo Workflows for orchestration in containerized environments.
  • Mastery of dbt for working with transformation layers.
  • Experience using SODA or similar tools for data quality assurance.

Responsibilities

  • Design and maintain ETL/ELT pipelines for healthcare data ingestion into BigQuery and Snowflake.
  • Develop high-performance transformations in dbt to standardize clinical data.
  • Manage complex workflows in GCP using Argo, ensuring reliability and fault tolerance.
  • Establish automated data quality measures with SODA, validating clinical data integrity.
  • Implement de-identification protocols to maintain HIPAA compliance while ensuring data usability.
  • Architect data models that facilitate easy querying of patient journeys.
  • Collaborate with DevOps to maintain secure and available data infrastructure.

Benefits

  • Directly contribute to research that improves patient outcomes.
  • Be part of innovative solutions in making data usable while ensuring privacy.
  • Opportunity for significant influence in shaping the engineering culture as an early hire.
Full Job Description
Description

The Mission

At OMNY Health, we are bridging the gap between clinical complexity and life-saving research. We are looking for a Data Engineer II who is passionate about the intersection of healthcare and technology. Your primary mission will be to architect and scale the pipelines that transform raw, messy clinical data into a high-fidelity, de-identified, research-ready data product. You will be a key player in managing our hybrid data landscape, extracting insights from our data sources, and curating them within our BigQuery and Snowflake environments. This role is about ensuring privacy at scale while maintaining the scientific utility of the data powering the next generation of medical breakthroughs.

Requirements

Key Responsibilities

  • Pipeline Development: Design, build, and maintain robust ETL/ELT pipelines to ingest structured and unstructured healthcare data into our BigQuery and Snowflake warehouses.
  • Modern Transformations: Lead the development of modular, high-performance transformations using stored procedures, and dbt (data build tool) to map raw clinical data to standardized research schemas in our Common Data Model (CDM).
  • Cloud-Native Orchestration: Deploy and manage complex workflows using Argo, ensuring high availability and fault tolerance within our GCP ecosystem.
  • Automated Data Quality: Implement "trust-but-verify" frameworks using SODA to monitor clinical data integrity, ensuring every record in our research product is validated and compliant.
  • De-identification & Privacy: Implement and automate sophisticated de-identification protocols (Safe Harbor or Expert Determination methods) to ensure HIPAA compliance while preserving data longitudinality.
  • Data Modeling: Architect scalable data models (Common Data Model) that allow researchers to query complex patient journeys with ease.
  • Infrastructure: Collaborate with DevOps to manage cloud-native data infrastructure, ensuring high availability and rigorous security controls.


Technical Qualifications

  • Experience: 3-5+ years in Data Engineering, with a focus on building production-grade healthcare pipelines.
  • GCP & Storage: Hands-on experience with Google Cloud Platform, specifically CloudSQL and BigQuery.
  • Warehousing: Deep expertise in BigQuery and Snowflake architectures, including performance tuning and secure data sharing.
  • Code & Orchestration: Expert-level Python and SQL.
  • Proven experience with Argo Workflows/Events for containerized orchestration.
  • Mastery of dbt for maintaining the transformation layer.
  • Quality Assurance: Experience using SODA (or Great Expectations) to define and enforce data contracts.
  • Healthcare Domain: Familiarity with healthcare-specific data challenges (ICD-10, FHIR, or provider-specific MS SQL schemas) is a significant plus.
  • Security Mindset: Understanding of HIPAA regulations and encryption standards.


Core Competencies

  • The "Curator" Mindset: You don't just move data; you care about its meaning. You understand that a "null" in a lab result is a clinical signal, not just a missing string.
  • Adaptability: You thrive in the "zero-to-one" phase where documentation might be thin, but the impact is massive.
  • Collaborative Spirit: You can speak "Data" to engineers and "Insight" to clinical researchers.


Our Tech Stack

  • Cloud: GCP
  • Databases: CloudSQL (MS SQL Server), BigQuery, Snowflake
  • Transformation: dbt
  • Orchestration: Argo
  • Validation: SODA
  • Languages: Python, SQL


What We Offer

Why Join Us?

  • Impact: Your work directly enables researchers to find cures and improve patient outcomes.
  • Innovation: We are tackling the hardest problem in health tech: making data usable without sacrificing privacy.
  • Growth: As an early hire, you will have a front-row seat (and a steering wheel) in building our engineering culture.

Note on De-identification: > Because this role focuses on a research-ready product, the candidate should be familiar with the trade-offs between data utility and privacy-specifically how to handle dates, zip codes, and unique identifiers in a way that satisfies both statisticians and compliance officers.

Similar Jobs

More Jobs at OMNY

More Healthcare Jobs

Find similar Data Engineer II (Healthcare Data Systems) jobs: