Full Job Description
The Senior Data Engineer is responsible for designing, developing, implementing, and optimizing enterprise-grade solutions and architectures, while ensuring scalability, performance, security, and cost-efficiency. This role applies advanced engineering principles to create scalable, reliable, and secure data pipelines and models that support analytics, reporting, AI, machine learning, and operational applications. This position will be responsible for supporting data architecture, assure data quality/integrity and implementing the data requirements, ETL design, development, implementation, and operations/maintenance. The Senior Data Engineer works independently, collaborates across teams, and influences solution direction by applying deep technical expertise and strong problem-solving skills. This role requires strong experience in data engineering, cloud technologies, and collaboration across technical and business stakeholders, with preferred skills in DevOps, infrastructure-as-code, and observability tools.
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable qualified individuals with disabilities to perform the essential duties.
This job description is a summary of the primary duties and responsibilities of the job and position. It is not intended to be a comprehensive or all-inclusive listing of duties and responsibilities. Contents are subject to change at the company's discretion.
Education
• Required - Bachelor's Computer Science, Engineering, or related field.
Work Experience
• Required - 9 years Experience implementing data quality checks, security, and governance standards. Strong Health System domain knowledge with experience in exploratory data analysis
• Preferred - 10+ years Experience with multiple Cloud Platforms (Azure, AWS, GCP) and related services
Experience working in an agile/scrum environment.
Knowledge Skills and Abilities (KSAs)
• Excellent analytical and problem-solving skills.
• Strong communication and ability to convey complex concepts simply.
• Ability to work independently and also work collaboratively in a team environment.
• Ability to mentor and support peers on technical topics.
• Strong knowledge of Epic Clarity/Caboodle data models.
• Hands-on data acquisition/integration experience designing, building, implementing and optimizing cloud data warehouse solutions.
• Strong experience in data engineering tools such as DBT and Azure Data Factory on Snowflake/Azure and orchestration tools like Airflow.
• Proficiency in programming languages such as Python or Scala, SQL, data modeling, ETL/ELT development, orchestration frameworks, and cloud platforms and related services (Data Lake Storage, Secrets management, Authentication methods).
• Proven Experience in designing complex data models to connect data across multiple domains.
• Strong understanding of DevOps practices, CI/CD, version control, and automation frameworks.
Job Duties
• Designs, builds, and optimizes scalable data pipelines for structured and unstructured data ingestion.
• Develops and maintains monitoring, automation, and performance tuning processes to ensure data reliability.
• Applies best practices in data modeling, ETL/ELT, and transformation to deliver secure, high-performance solutions.
• Designs and standardizes cross-domain data models to enable consistent, enterprise-wide analytics.
• Translates business requirements into scalable, secure, and value-driven technical solutions.
• Selects and implements appropriate technologies across databases, streaming, orchestration, and cloud platforms.
• Identifies and recommends opportunities to leverage AI/ML to advance data solutions.
• Contributes to CI/CD pipelines and drives automation to improve operational efficiency.
• Ensures data quality, integrity, security, and compliance; proactively monitors and remediates risks.
• Collaborates with stakeholders, mentors junior engineers, and drives continuous improvement through code reviews and solution evaluation.
• Performs other duties as assigned
• Complies with all policies and standards
The above statements describe the general nature and level of work only. They are not an exhaustive list of all required responsibilities, duties, and skills. Other duties may be added, or this description amended at any time.
Remains knowledgeable on current federal, state and local laws, accreditation standards or regulatory agency requirements that apply to the assigned area of responsibility and ensures compliance with all such laws, regulations and standards.
Physical and Environmental Demands
The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
Sedentary Work- Exerting up to 10 pounds of force occasionally (occasionally means activity or conditions exist up to 1/3 of the work day), and/or, a negligible amount of force frequently (frequently means activity or condition exists from 1/3 to 2/3 of the work day) to lift, carry, push, pull, or otherwise move objects, including the human body. Sedentary work involves sitting most of the time but may involve walking or standing for brief periods of time. Jobs are sedentary if walking and standing are required only occasionally and all other sedentary criteria are met.
Normal routine involves no exposure to blood, body fluid or tissue and as part of their employment, incumbents are not called upon to perform or assist in emergency care or first aid.
The incumbent has no occupational risk for exposure to communicable diseases .
Because the incumbent works within a healthcare setting, there may be occupational risk for exposure to hazardous medications or hazardous waste within the environment through receipt, transport, storage, preparation, dispensing, administration, cleaning and/or disposal of contaminated waste. The risk level of exposure may increase depending on the essential job duties of the role.