Qualifications

• 5+ years of experience in data engineering or a related field.
• Proficiency in Databricks, particularly Notebooks and Delta Lake.
• Strong programming skills in Python and PySpark.
• Solid experience in ETL and data pipeline development.
• Familiarity with big data technologies, including Hadoop and Kafka.
• Demonstrated SQL querying and data modeling skills.
• Experience with cloud platforms, specifically AWS or GCP.

Responsibilities

• Design and maintain scalable data pipelines and ETL solutions.
• Build frameworks for ingesting structured and unstructured data.
• Implement data quality and governance processes.
• Develop data infrastructure to integrate diverse data sources.
• Support analytics and machine learning initiatives.
• Collaborate with Data Scientists to curate data for analysis.
• Mentor junior data engineers and drive best practices.

Benefits

• Discretionary annual incentive.
• Comprehensive medical coverage including dental and vision.
• Family support with maternal and parental leaves.
• Insurance options for auto, home, and identity theft protection.
• Convenience benefits including commuter perks and training reimbursement.
• Generous time off policy including vacation and holidays.
• Legal and financial assistance programs, including a 401K plan.