OverviewTheData Engineer IVis a senior member of the Office of the Chief Data Office (OCDO)Data Engineering team leading the development of new translational data infrastructure, integrations, and user-facing applications. This role combines deep data engineering expertise in the Databricks Lakehouse ecosystem with hands-on experience in designing and operatingcloud infrastructure-as-code (IaC)onAWSusingTerraform.
This engineer will be responsible for ensuring data pipelines, compute infrastructure, and security architecture are aligned, reproducible, and cost-efficient. The ideal candidate will lead by example in engineering excellence, reliability, and collaboration, helping the team scale data services for research and clinical innovation in a secure, compliant, and responsive environment.
Responsibilities
- Lead the research, design, and development of data solutions to address analytical, research, and clinical data requirements, ensuring system scalability, security, performance and reliability.
- Design and maintain data applications such as interfaces, ingestion pipelines, data transfer mechanisms and data partition strategies using Databricks, Delta Lake, Unity Catalog, and related cloud technologies to enable efficient access of data structures.
- Develop prototypes and pilot new data engineering solutions to determine their viability for adoption and long-term operational support.
- Lead the planning process around future growth scalability, and optimization of data solutions.
- Establish and support data standards, governance practices, lineage tracking, and data quality processes.
- Lead efforts to improve processes and meet strategic goals for data engineering, data management, infrastructure management, infrastructure automation, and platform reliability.
- Proactively identify issues, troubleshoot and tune data solutions for scientific computing.
- Work with internal stakeholders to correctly scope, define, implement, and deliver data platform solutions.
- Prepare and present technical information on data solutions to all levels of stakeholders.
- Independently organize and manage multiple complex projects, priorities, and technical initiatives simultaneously.
- Prepare and maintain written technical design specifications, flow charts and data flow diagrams as needed for new and existing applications.
Qualifications
MINIMUM QUALIFICATIONS:
- BS in Computer Science, Engineering or equivalent experience.
- Minimum of 10 years of experience with various database platforms, reporting tools, and data structures.
- Minimum of 10 years of experience with database design and ETL development.
- Minimum of 10 years of experience in technical leadership.
- Proficient in one or more scripting language.
- In-depth knowledge and expertise of database technologies, along with solid programming, design and system analysis skills.
- Proven track record researching, implementing and socializing technical solutions.
PREFERRED QUALIFICATIONS:
- Advanced skills using and collaborating on code development using git/GitHub and deep familiarity with SDLC processes and implementation.
- CI/CD automation experience including testing and environment promotion for data pipelines.
- Proven experience designing and operatingDatabricks based pipelines (Delta Lake, Jobs/Workflows, DLT).
- ProficiencyinAWSservices (S3, IAM, Lambda, EC2, networking) and pipeline troubleshooting.
- Strong debugging, cost-performance tuning, and incident remediation skills.
- Experience mentoring engineers, leading design sessions, anddemonstratedownership and reliability of data engineering implementations.
- Deep familiarity withDatabricks 6AWS integrations, including Terraform-based cluster management and policy enforcement.
- Experience in regulated or healthcare environments (e.g., HIPAA, FHIR, OMOP).
- Familiarity withdata governance, lineage, and observability tools(e.g., Great Expectations, Monte Carlo).
- Hands-on experience withTerraformor otherIaCtools for infrastructure management.
- Experience withAirflow,dbt, orDagsterfor orchestration and transformation design.
The annual base salary range for this position is from $133,328 to $210,725, and pay offered will be based on experience and qualifications. This position may be eligible for relocation assistance.Although Fred Hutch is not sponsoring most H-1B visas at this time, candidates who already hold an H-1B sponsored by another organization and are currently in the U.S. may be eligible for this position.Fred Hutchinson Cancer Center offers employees a comprehensive benefits package designed to enhance health, well-being, and financial security. Benefits include medical/vision, dental, flexible spending accounts, life, disability, retirement, family life support, employee assistance program, onsite health clinic, tuition reimbursement, paid vacation (12-22 days per year), paid sick leave (12-25 days per year), paid holidays (13 days per year), and paid parental leave (up to 4 weeks).