Gentiva

Databricks Data Engineer

Gentiva$110K — $130K *
Healthcare
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science or related field
  • 5+ years of experience in data engineering or software development
  • 3+ years of hands-on experience with Databricks
  • Strong experience with Apache Spark and PySpark
  • Databricks Certified Data Engineer Associate preferred

Responsibilities

  • Translate business requirements into technical specifications
  • Design and maintain ETL/ELT pipelines with Azure Data Factory
  • Implement Delta Lake architecture for data management
  • Optimize data workflows using Databricks Workflows
  • Develop and maintain CI/CD pipelines for data workflows
  • Monitor and troubleshoot data pipeline performance
  • Document data processes and best practices

Benefits

  • Comprehensive health insurance
  • 401k plan
  • Tuition reimbursement
  • Paid time off (PTO)
  • Opportunities for professional growth and development
Full Job Description
Overview

TheDatabricks Data Engineer will be part of the Data Services team and help transform the delivery of data driven insights at scale. In this role, they will design and engineer robust data pipelines using technologies like Databricks, Azure Data Factory, Apache Spark, and Delta Lake. This role will work hands on crafting healthcare data solutions - processing massive healthcare datasets, optimizing performance, and ensuring our data is accurate, secure, and accessible when it matters most.

Essential Functions
  • Translate business requirements into technical specifications and document solution designs, data flows and architecture
  • Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory, Databricks and Apache Spark
  • Implement Delta Lake architecture for reliable data storage and processing
  • Build and optimize data workflows using Databricks Workflows and Jobs
  • Develop scalable data models following medallion architecture (bronze, silver, gold layers)
  • Implement Unity Catalog for data governance, access control, and metadata management
  • Create and maintain Databricks notebooks for data transformation and analysis
  • Optimize Spark jobs for performance and cost efficiency
  • Implement data quality checks and validation frameworks
  • Collaborate with BI developers, data analysts, and data scientists
  • Design and implement data orchestration workflows using Azure Data Factory to coordinate complex ETL/ELT processes
  • Develop and maintain CI/CD pipelines for data workflows
  • Monitor data pipeline performance and troubleshoot issues
  • Document data processes, architectures, and best practices
  • Ensure compliance with data security and privacy regulations
  • Provide support for new and existing solutions
About You

Knowledge/Skills/Abilities/Expectations:

  • Excellent problem-solving and analytical skills
  • Strong oral and written communication abilities
  • Self-motivated with ability to adapt to new technologies quickly
  • Team player with ability to work independently
  • Detail-oriented with strong organizational skills
  • Ability to manage multiple priorities and meet deadlines
  • Experience communicating technical concepts to non-technical stakeholders

Technical Skills:

  • Databricks Platform:
    • Expert-level knowledge of Databricks Workspace, clusters, and notebooks
    • Delta Lake implementation and optimization
    • Unity Catalog for data governance and cataloging
    • Databricks SQL and SQL Analytics
    • Databricks Workflows, Delta Live Tables, and job orchestration
    • Delta Live Tables (DLT) for pipeline orchestration and data quality
  • Programming & Development:
    • Advanced Python programming (PySpark, pandas, NumPy)
    • Advanced SQL (query optimization, performance tuning)
    • Scala programming (preferred)
    • Git version control and collaborative development
  • Cloud Technologies:
    • Azure Databricks
    • Cloud storage services (ADLS Gen2, Azure Blob Storage)
    • Azure Data Factory for pipeline orchestration and integration
    • Experience designing and managing Azure Data Factory pipelines, triggers, and linked services
    • Infrastructure as Code (Terraform)
  • Business Intelligence & Analytics:
    • Experience with BI tools (Power BI, SSRS)
    • Data warehousing and data modeling concepts
    • SQL Server, including SSIS (Integration Services)
    • MLflow for ML lifecycle management (plus)
  • Preferred Additional Skills
    • Experience with complex data modeling including dimensional modeling, star/snowflake schemas
    • Experience with medallion architecture (bronze/silver/gold layers)
    • Data quality and validation framework implementation
    • CI/CD pipeline development for data workflows (Azure DevOps)
    • Performance tuning and cost optimization
    • DataOps and DevOps practices

Education/Experience:

  • Bachelor's degree in Computer Science, Information Technology or related field
  • 5+ years of progressive experience in data engineering, analytics, or software development
  • 3+ years of hands-on experience with Databricks platform
  • Strong experience with Apache Spark and PySpark
  • Healthcare IT or healthcare data experience preferred

Licenses/Certification:

  • Databricks Certified Data Engineer Associate (strongly preferred)
  • Databricks Certified Data Engineer Professional
  • Databricks Lakehouse Fundamentals
  • Azure Data Engineer Associate (DP-203)
  • Apache Spark certifications
We Offer
  • Comprehensive Benefits Package: Health Insurance, 401k Plan, Tuition Reimbursement, PTO
  • Opportunity to participate in a Fleet Program
  • Competitive Salaries
  • Mileage Reimbursement
  • Professional growth and development opportunities
LocationGentiva

About Gentiva

Gentiva Hospice Careers

There has never been a more opportune time to join Gentiva Hospice, a leading provider in the healthcare sector dedicated to compassionate care and professional excellence. Gentiva Hospice offers a variety of job opportunities that enable professionals to contribute to meaningful work in a supportive and innovative environment.

Work You’ll Do

Join Gentiva Hospice’s team to assist in delivering top-notch care and support to patients and their families. This role is crucial in transforming the approach to hospice care through dedication, compassion, and cutting-edge practices. Lead with professionalism in a role that intersects healthcare expertise, leadership, and empathetic service. Gentiva Hospice provides a platform for professionals to drive significant impact in the hospice care industry. Engage with a diverse team of healthcare professionals to navigate the complexities of end-of-life care, ensuring every patient receives the highest standard of dignity and respect. Collaborate with over 10,000 dedicated employees across various interdisciplinary roles, all united in their commitment to patient care and family support.

Introducing Gentiva Hospice Employment Opportunities

Gentiva Hospice is building a robust workforce to support the growing need for specialized hospice care across the country. The company offers a range of positions from entry-level to senior leadership roles, ensuring a place for every skill level and professional aspiration.

Innovate in Your Role

At Gentiva Hospice, innovation is at the core of daily operations. Employees are encouraged to bring fresh ideas that enhance patient care and operational efficiency, ensuring the company remains at the forefront of the hospice care industry.

Develop Your Career

Gentiva Hospice is committed to the growth and development of its team. With comprehensive training programs, leadership development opportunities, and a commitment to promoting from within, employees have access to the tools needed to advance their careers and expand their professional capabilities.

Explore Benefits and Culture

Gentiva Hospice is proud of its inclusive culture that celebrates diversity and fosters a sense of belonging. The company offers competitive benefits, including health insurance, retirement plans, and paid time off, alongside continuous education and diversity training programs.

The Gentiva Hospice Commitment to Excellence

With a focus on leadership and innovation, Gentiva Hospice leads the way in developing industry standards for quality care and ethical practices. The collaboration of skilled professionals through networking and teamwork ensures that the company can overcome challenges and continue to deliver exceptional service to patients and their families.

Stay Connected

Join the Gentiva Hospice Team

Explore open positions that match your skills and interests. Gentiva Hospice seeks passionate, curious, and solution-driven team players for its various job openings.

SEARCH GENTIVA HOSPICE JOBS

Keep Up to Date

Stay informed with career tips, insider perspectives, and industry-leading insights you can put to use today—all from the professionals who work at Gentiva Hospice.

READ CAREERS BLOG

Job Alert Emails

Customize your subscription to receive job alerts, the latest news, and insider tips tailored to your preferences. Discover the exciting and rewarding career opportunities that await at Gentiva Hospice.
Learn more about Gentiva
Industry

Similar Jobs

More Jobs at Gentiva

More Healthcare Jobs

Find similar Databricks Data Engineer jobs: