Northwell Health

Lead Data Engineer - Data Platform Engineering (Hybrid)

Northwell Health$120K — $150K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's Degree or equivalent education and experience required.
  • 5-7 years of relevant experience in data engineering and advanced data technologies required.
  • High proficiency in Apache Hadoop, NoSQL, cloud clusters, and Apache Spark.
  • Extensive experience with Google Cloud Platform (GCP) highly preferred.
  • Experience with Python frameworks such as FastAPI, Pandas, and Polars is favored.
  • Familiarity with infrastructure as code tools, particularly Terraform, is a plus.
  • Experience with workflow orchestration tools like Airflow and DBT is advantageous.

Responsibilities

  • Lead the implementation of information systems to align with user requirements.
  • Serve as a communication bridge between departments and project teams during systems implementation.
  • Develop specifications that meet departmental goals effectively.
  • Innovate and create systems for advanced data tracking.
  • Collaborate with internal and external partners on managed care contract projects.
  • Maintain ongoing communication with vendors regarding application systems.
  • Conduct post-installation reviews to assess system performance and effectiveness.
  • Facilitate training sessions for staff and management as needed.

Benefits

  • Opportunity to build critical data infrastructure from scratch.
  • Hands-on experience with cutting-edge data technologies and tools.
  • Mentorship and leadership roles in team development.
  • Engagement in large-scale data challenges and problem-solving.
  • Potential involvement in complex regulatory compliance initiatives.
Full Job Description
Job Description

Job Description

We're looking for a hands-on Lead Data Engineer to architect and build the data pipelines and infrastructure that power our analytics, ML, and business intelligence capabilities. You'll design greenfield data solutions while modernizing our existing systems to create a scalable, reliable, and performant data platform. Leads the implementation of information systems to manage financial functions for Patient Financial Services/Accounts. Oversees projects and initiatives to meet user requirements. Serves as a liaison between department (user) and vendors. Ensures systems compliance to applicable laws, regulatory standards and policies. This is a unique opportunity to own critical data infrastructure from the ground up. You'll spend your time building robust ETL/ELT pipelines, optimizing data models, building reusable and extensible frameworks, and mentoring the team all while solving complex challenges around data ingestion, transformation, and orchestration at scale.

Job Responsibility

  • Coordinates implementation of information system initiatives to meet user requirements.
  • Communicates with user departments and project teams regarding implementation activities and system changes to ensure feasibility.
  • Develops system specifications that appropriately meet department requirements.
  • Develops systems to track data in comprehensive and innovative ways.
  • Collaborates with hospital departments and outside vendors to facilitate managed care contract implementation.
  • Coordinates and maintains communication between the hospital and vendor(s) regarding system applications.
  • Performs periodic post-installation reviews of system initiatives.
  • Conducts system-wide in-services with managers and staff, as necessary.
  • Ensures systems compliance to applicable laws, regulatory standards and policies.
  • Uses knowledge and skills to contribute to the development of functional objectives and principles to achieve goals in innovative ways. Problems addressed are of diverse scope and complexity ranging from moderate to substantial.
  • Performs related duties as required. All responsibilities noted here are considered essential functions of the job under the Americans with Disabilities Act. Duties not mentioned here, but considered related are not essential functions.

Job Qualification
  • Bachelor's Degree required, or equivalent combination of education and related experience.
  • 5-7 years of relevant experience including technical experience with Apache Hadoop, NoSQL, setting up cloud clusters, Apache Spark, and other advanced data science and big data technologies, required.

HIGHLY PREFERRED
  • Extensive Google Cloud Platform (GCP) experience
  • Previous experience as a Data Platform Engineer/ Data Engineer/ Analytics Engineer for a large organization
  • Experience in/ with Python (FastAPI, Pandas, Polars, etc.)
  • Experience with infrastructure as code, specifically Terraform
  • Extensive experience with Airflow, DBT, and/ or Dataform
  • Experience with OpenLineage, OpenMetadata and data contracts
  • Extensive experience with BigQuery, CloudSQL, Pub/ Sub, Dataflow, Cloud Storage, etc.
  • Experience with the Cloud Healthcare API/ FHIR/ HL7


*Additional Salary Detail
The salary range and/or hourly rate listed is a good faith determination of potential base compensation that may be offered to a successful applicant for this position at the time of this job advertisement and may be modified in the future.When determining a team member's base salary and/or rate, several factors may be considered as applicable (e.g., location, specialty, service line, years of relevant experience, education, credentials, negotiated contracts, budget and internal equity).

About Northwell Health

Northwell Health is a non-profit healthcare organization that provides clinical care, research, and medical education in New York. It is the largest healthcare provider and private employer in the state of New York, with over 72000 employees. Northwell Health has 23 hospitals and more than 700 outpatient facilities, as well as a medical school and a research institute. The organization was founded in 1997 as North Shore-Long Island Jewish Health System and changed its name to Northwell Health in 2015.
Learn more about Northwell Health
Size
72,000 employees
Industry
Founded
1997

Similar Jobs

More Jobs at Northwell Health

More Information Technology Jobs

Find similar Lead Data Engineer - Data Platform Engineering (Hybrid) jobs: