Role Overview:The Azure Data Engineer will be responsible for designing, developing, and maintaining scalable data pipelines utilizing modern cloud technologies, with a strong focus on Microsoft Azure. This role involves building and optimizing data ingestion, transformation, and integration frameworks, implementing robust data quality controls, and actively participating in cloud migration and modernization initiatives. The successful candidate will apply software engineering principles to data solutions, drive automation, and contribute to architectural discussions.
Key Responsibilities:- Design, develop, and maintain scalable data pipelines using modern cloud technologies.
- Build and optimize data ingestion, transformation, and integration frameworks.
- Develop reusable components, utilities, and accelerators to reduce development effort and improve delivery speed.
- Implement robust data quality, monitoring, auditability, and operational controls.
- Design solutions that support both batch and event-driven processing patterns.
- Participate in cloud migration and modernization efforts.
- Leverage cloud-native services to improve scalability, reliability, security, and cost efficiency.
- Evaluate emerging technologies and recommend innovative solutions aligned with enterprise architecture standards.
- Apply software engineering principles to data engineering solutions.
- Drive automation across deployment, testing, monitoring, and operational support processes.
- Continuously improve platform performance, reliability, and maintainability.
- Troubleshoot complex production issues and provide timely resolutions.
- Partner with business stakeholders, architects, and product teams to translate requirements into technical solutions.
- Mentor junior engineers and promote engineering best practices.
- Contribute to architectural discussions and technology evaluations.
- Foster a culture of continuous learning, innovation, and ownership.
Required Skills:- Strong experience with SQL, Python, and large-scale data processing.
- Hands-on experience with Microsoft Azure.
- Experience with modern data platforms such as Databricks and Apache Spark.
- Strong programming skills in Python.
- Experience designing scalable ETL/ELT pipelines.
- Familiarity with CI/CD, DevOps, and Infrastructure-as-Code principles.
- Experience working with relational and distributed data platforms.
Qualifications:- Bachelor's degree in Computer Science, Engineering, Information Systems, or related field.
- 7+ years of experience in Data Engineering, Software Engineering, or related technical roles.
Preferred Skills:- Experience with event-driven architectures.
- Experience with streaming platforms.
- Experience with API integrations.
- Experience with data warehousing and lakehouse architectures.
- Knowledge of data governance.
- Knowledge of metadata management.
- Knowledge of data quality frameworks.
- Knowledge of observability and monitoring solutions.
- Experience building reusable frameworks and shared engineering utilities.
- Exposure to AI/ML enablement platforms and modern analytics ecosystems.
