Job DescriptionData Engineers design and build data systems and pipelines. Responsibilities include developing data processing workflows, optimizing data storage, and ensuring data accuracy. You will collaborate with data scientists and analysts to meet data requirements and resolve data issues. Strong experience in data engineering and problem-solving skills are required.
Responsibilitiesa { text-decoration: none; color: #464feb; } tr th, tr td { border: 1px solid #e6e6e6; } tr th { background-color: #f5f5f5; }
Required Skills Databricks
- Databricks Workspace
- Databricks Jobs & Workflows
- Delta Lake
- Delta Live Tables (DLT)
- Unity Catalog
- Databricks SQL
- MLflow (preferred)
Programming
- PySpark
- Python
- SQL
- Spark SQL
Data Engineering
- ETL / ELT Design
- Data Warehousing
- Data Lakes
- Batch Processing
- Real-Time Streaming
- Data Modeling
Cloud Platforms (Any One)
- Microsoft Azure
- Amazon Web Services (AWS)
- Google Cloud Platform (GCP)
Tools
- Git
- Azure DevOps / Jenkins / GitHub Actions
- Airflow (preferred)
- Kafka/Event Hub (preferred)
QualificationsBachelor's/Master's in Engineering 2-5 years
