Qualifications

• Strong Python and advanced SQL programming skills.
• Hands-on experience with Databricks Lakehouse platform features like Delta Lake and Unity Catalog.
• Proficient in dbt for data transformation and documentation tasks.
• Experience with infrastructure as code using Terraform for AWS or GCP deployments.
• Familiar with Git for CI/CD workflows and orchestration tools such as Apache Airflow.
• Ability to articulate technical decisions clearly in client engagements.
• Strong problem-solving skills in navigating and modernizing legacy data systems.

Responsibilities

• Build and modernize data pipelines from legacy systems to high-performance Lakehouses using PySpark and Databricks.
• Write modular and tested dbt models to convert raw data into business-ready datasets.
• Provision cloud infrastructure programmatically using Terraform and enforce governance practices.
• Design automated ELT/ETL workflows to maintain data quality and compliance with SLAs.
• Engage directly with clients in daily standups and code reviews to ensure timely project delivery.
• Debug and optimize data pipelines and complex queries to improve performance and reduce costs.

Benefits

• Opportunity to work with modern technologies and cloud-native solutions.
• Collaborative environment with global engineering teams and client engagement.
• Emphasis on quality coding practices with a passion for reusable and documented code.
• Potential for career advancement in data engineering and consulting roles.
• Access to training and resources for obtaining relevant certifications such as Databricks or AWS.