What You Will Do:
- Design, develop, and maintain data pipelines using Databricks
- Build and optimize ETL/ELT processes to ingest, transform, and load data from various source systems.
- Collaborate with business analysts, data scientists, and stakeholders to understand data requirements and deliver reliable datasets.
- Monitor data pipeline performance and troubleshoot data quality or processing issues.
- Develop and maintain data models, documentation, and metadata.
- Support the implementation of data governance, security, and data quality standards.
- Assist in managing cloud-based data infrastructure and storage solutions.
- Participate in code reviews and follow best practices for data engineering and software development.
- Support reporting and analytics teams by creating and maintaining curated data assets.
- Continuously learn and apply new technologies, tools, and methodologies within the data engineering ecosystem.
You'll Need to Have:- 3 years of experience in data engineering, data integration, or related technical roles.
- Hands-on experience with Databricks preferred.
- Proficiency in SQL and experience querying large datasets.
- Experience with Python for data processing and automation.
- Understanding of ETL/ELT concepts and data pipeline development.
- Familiarity with cloud platforms such as Microsoft Azure, AWS, or Google Cloud.
- Basic knowledge of data warehousing concepts and dimensional modeling.
Compensation Range:$110,000.00-$130,000.00
Placement in the salary range will be decided upon completion of the interview process. Salary determination will be determined based on factors including but not limited to relevant experience, demonstrated skills related to the requirements of the role, education, certifications, and geographic location.
