Role: Databricks ETL Developer

Location: Remote

Role Overview

We are seeking an experienced Databricks ETL Developer with strong expertise in data engineering, ETL development, Databricks, PySpark, Python, and SQL. The ideal candidate will have hands on experience building scalable ETL/ELT pipelines, developing data ingestion and transformation processes, and working with large scale data processing environments.

The candidate will also be responsible for understanding and documenting existing data flows, pipelines, integration points, and current state data architecture within Databricks environments.

Required Skills
• 5+ years of experience in Data Engineering or ETL
• 3+ years of hands on experience with Databricks
• Strong hands on experience with PySpark
• Strong Python development experience
• Strong SQL development experience
• Experience developing and maintaining ETL/ELT pipelines
• Experience with large scale data processing
• Strong understanding of data ingestion and transformation processes
• Experience with data validation and data quality checks
• Strong troubleshooting and problem solving skills

Key Responsibilities
• Develop and maintain ETL/ELT pipelines using Databricks and PySpark
• Build data ingestion and transformation processes from multiple source systems
• Develop and optimize PySpark code for large scale data processing
• Develop and optimize SQL queries and data processing logic
• Perform data validation and data quality checks
• Implement error handling and data validation processes
• Map and document existing ETL data flows and pipelines
• Document integration points and dependencies within Databricks environments
• Assess current state data architecture
• Analyze source systems, interfaces, integrations, and dependencies
• Collaborate with technical and business teams to understand data requirements
• Identify opportunities to improve data processing, pipeline performance, and data quality
• Troubleshoot ETL and data processing issues and implement appropriate solutions

Education Requirement:

Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field preferred. Equivalent professional experience may be considered.

Our Commitment to Environment

Actively contribute to Apexon's commitment to environmental responsibility by following sustainable practices and supporting ESG initiatives.

Our Perks and Benefits

Our benefits and rewards program has been thoughtfully designed to recognize your skills and contributions, elevate your learning experience, and provide care and support for you and your loved ones.

We also offer:
• Health Insurance with Dental & Vision
• 401K Plan
• Life Insurance, STD & LTD
• Paid Vacations & Holidays
• Continuous Skill Based Development and Career Advancement Opportunities