City/State
Virginia Beach, VA
Work Shift
First (Days)
Overview:
This is a fully remote position.
Work Location:
Remote opportunities available in the following states: Alabama, Delaware, Florida, Georgia, Idaho, Indiana, Kansas, Louisiana, Maine, Maryland, Minnesota, Nebraska, Nevada, New Hampshire, North Carolina, North Dakota, Ohio, Oklahoma, Pennsylvania, South Carolina, South Dakota, Tennessee, Texas, Utah, Virginia, Washington (state), West Virginia, Wisconsin, Wyoming
OverviewWe are looking for a Data Engineer to support a modern data platform built on Databricks. This role will focus on building scalable data pipelines, supporting a metadata-driven ingestion framework, and ensuring data quality and governance are embedded into the platform.
Key Responsibilities
- Develop and maintain data pipelines usingPySpark and Databricks
- Work within ametadata-driven ingestion frameworkto onboard new datasets
- Implementdata quality checks and validation ruleswithin pipelines
- Support ingestion fromfile-based sources and ingestion tools (e.g., Fivetran)
- Handleschema changes, incremental loads, and file processing patterns
- Contribute todata governance practicesincluding tagging, metadata, and lineage
- Troubleshoot and resolve pipeline failures and performance issues
- Collaborate with architects and stakeholders ondata onboarding and requirements
- Follow and contribute tocoding standards, reusable components, and best practices
Education- Experience in lieu of a Bachelor27s Degree
- 3+ years of relevant experience with a degree
- 5+ years of relevant experience without a degree
Certification/Licensure- No specific certification or licensure requirements
Experience- Required to 3 to 5 years of relevant experience
- Hands-on experience withPySpark and Databricks
- Strong SQL skills
- Experience buildingETL/ELT data pipelines
- Understanding ofDelta Lake concepts(merge, schema evolution, partitions)
- Familiarity withcloud platforms (Azure preferred)
- Basic experience withGit and version control
- Exposure todata catalog or governance tools (e.g., DataHub)
- Experience withFivetran or similar ingestion tools
- Understanding ofdata quality and validation concepts
- Experience working withmetadata-driven frameworks
- Strong problem-solving and debugging skills
- Ability to work in a structured, framework-driven environment
- Focus on data quality, not just pipeline execution
- Willingness to learn and adapt in a fast-evolving data ecosystem
We provide market-competitive compensation packages, inclusive of base pay, incentives, and benefits. The base pay rate for Full Time employment is: $80,204.80 - $133,681.60. Additional compensation may be available for this role such as shift differentials, standby/on-call, overtime, premiums, extra shift incentives, or bonus opportunities.
Keywords: Data Engineer, Azure, ACP, Azure Cloud Platform, Fivetran, metadata, PySpark, Databricks
Benefits: Caring For Your Family and Your Career
Medical, Dental, Vision plans
Adoption, Fertility and Surrogacy Reimbursement up to $10,000
Paid Time Off and Sick Leave
Paid Parental & Family Caregiver Leave
Emergency Backup Care
Long-Term, Short-Term Disability, and Critical Illness plans
Life Insurance
401k/403B with Employer Match
Tuition Assistance 6 $5,250/year and discounted educational opportunities through Guild Education
Student Debt Pay Down 6 $10,000
Reimbursement for certifications and free access to complete CEUs and professional development
Pet Insurance
Legal Resources Plan
Colleagues have the opportunity to earn an annual discretionary bonus ifestablished system and employee eligibility criteria is met.
For positions that are available as remote work, Sentara Health employs associates in the following states:
Alabama, Delaware, Florida, Georgia, Idaho, Indiana, Kansas, Louisiana, Maine, Maryland, Minnesota, Nebraska, Nevada, New Hampshire, North Carolina, North Dakota, Ohio, Oklahoma, Pennsylvania, South Carolina, South Dakota, Tennessee, Texas, Utah, Virginia, Washington, West Virginia, Wisconsin, and Wyoming.
