Data Engineer

Job Description Summary
General Summary
The Data Engineer is a member of the Data Platform Engineering team, working in a dynamic cross-functional environment to assist in developing the strategic direction and the meaningful use of data within the organization for our next generation data platform to provide a full and self-service environment for clinicians, researchers, administrators and executives. Assists with development or selection of data models to be implemented in support of clinical, quality improvement, and research objectives. Creates ETL pipelines for data to and from various cloud and local sources consistent with existing data models. Adapts database systems and architecture as necessary to meet the operational, analytical, and reporting needs of the organization.

The Data Engineer will consistently demonstrate support of the Shirley Ryan AbilityLab statement of Vision, Mission and Core Values by striving for excellence, contributing to the team efforts and showing respect and compassion for patients and their families, fellow employees, and all others with whom there is contact at or in the interest of the institute.

The Data Engineer will demonstrate Shirley Ryan AbilityLab Core Attributes: Communication, Accountability, Flexibility/Adaptability, Judgment/Problem Solving, Customer Service and Core Values (Hope, Compassion, Discovery, Collaboration, & Commitment to Excellence) while fulfilling job duties.

Job Description

The Data Engineer will:

• Collaborate within the Data Platform Engineering team, Data Analytics and Data Governance teams, other Information Services (IS) teams, executive leadership, external consultants, and stakeholders from various departments within the hospital to:
• Primarily utilizing existing resources, assist in developing secure, stable, scalable long-term plans for the flow of the hospital's data.
• Assist in the development of scalable data infrastructure and platforms to collect and process large amounts of data, including structured and unstructured data for analysis by clinical, research, and business resources. Data sources may be internally (locally) or externally (cloud) sourced, both data owned by the organization and external to the organization from partners and vendors.
• Establish methods and procedures for tracking data quality, completeness, redundancy, compliance and improvement along with related system operational performance.
• Create strategies and plans for data capacity planning, data security, life cycle data management, scalability, backup and archiving.
• Create the mapping of data sources, data movement, interfaces, and analytics, with the goal of ensuring data quality and accurate downstream delivery and reporting.
• Define standards for engineering and architecture including naming, describing, managing, modeling, cleaning, enriching, transforming, transferring, storing, searching, and delivering data securely within the hospital.
• Assist with data stewardship by tagging and defining data elements in collaboration with subject matter experts and the Data Governance team.
• Participate in data structure and information model design across multiple stakeholders.
• Acquire and maintain data from primary or secondary data sources.
• Identify and evaluate opportunities for enhancement of current data architecture and data management technologies.
• Monitor, update, and ensure consistent uptime, availability and access of the data platform and other data systems for performance and reliability.
• Develop processes to support the deployment of high quality, flexible, and secure data management solutions
• Leverage available tools to drive Automation of key data management processes
• Create instrumentation and metrics to ensure ecosystem health & ensure continuous improvement of KPI's

Reporting Relationships

• Reports directly to the Director Data Platform Architecture

Knowledge, Skills & Abilities Required

• Bachelor's or master's degree in computer science or computer engineering, or in a related area (data science, mathematics, statistics, economics, etc.) with demonstrated proficiency in the skills below.
• Expertise in SQL (5 years professional) with experience with MySQL, PostgreSQL and their derivatives in building complex queries, tuning, and optimization
• Expertise in Python and/or Java (5 years professional) with a focus on data manipulation, database interaction, ETL automation, big data technologies, and performance optimization
• Knowledge and understanding of HIPAA and ability to implement data security standards in line with those requirements including inter-operability with HL7 and FHIR.
• At least 2-5 years of professional experience establishing ETL/ELT processes for securely transporting data between cloud and local databases. Experience doing so between Snowflake, AWS RDS (Aurora), OCI, Microsoft Power Apps, and using Informatica is a plus.
• Experience with other AWS data utilities (API gateway, S3, etc.) is a plus.
• Demonstrated experience in handling large data sets and relational databases, data warehousing, scalability, reliability, access and provisioning.
• Experience evaluating and leveraging AI utilities in data warehouse and data governance tools for model and pipeline development while ensuring quality data for the analytics layer and self-services.
• Strong communication skills, particularly those relevant to translating highly technical information for non-technical audiences in terms of documentation and diagrams.
• Demonstrated ability to manage and see through long-term projects.
• Proactive work habits such as proposing and developing new projects and initiatives or advocating and promoting incremental adoption of new technologies.
• Candidates familiar with Oracle-Cerner EHR systems, particularly the Millennium data model and CCL, will receive strong consideration.
• Candidates familiar with research CDMs like OMOP, i2b2, and PCORnet will be strongly considered.
• Candidates with experience developing REST/RESTful APIs, streaming platforms, and role-based access and encryption will also be strongly considered.

Working Conditions

• Normal office environment with little or no exposure to dust or extreme temperature.

Pay and Benefits*:

Pay Range: $71,278.00 annually - $124,500.00 annually

Benefits: Shirley Ryan AbilityLab offers a comprehensive benefits program that is competitive with our industry peers in our geographic locations: https://www.sralab.org/benefits

*Benefits and benefits' eligibility can vary by position. Actual compensation will vary based on applicant's experience and qualifications, as well as internal equity.

The above statements are intended to describe the general nature and level of work being performed by people assigned to this classification. They are not intended to be construed as an exhaustive list of all responsibilities, duties and skills required of personnel so classified.

Pay and Benefits*:

Pay Range:
$71,200.00 - $124,500.00

Benefits:

Shirley Ryan AbilityLab offers a comprehensive benefits program that is competitive with our industry peers in our geographic locations: https://www.sralab.org/benefits

*Benefits and benefits' eligibility can vary by position. Actual compensation will be determined by equity and qualifications of the role.