Familiar with Apache Airflow for workflow orchestration
Knowledge of Apache Spark for big data processing
Experience with Docker and containerization technologies
Responsibilities
Create and maintain data workflows using Apache Airflow
Build scalable and reliable workflow orchestration solutions
Collaborate with data engineers and platform teams
Ensure workflows are efficient and production-ready
Implement security measures for data workflows
Monitor and optimize workflow performance
Benefits
Collaborative work environment with cross-functional teams
Opportunities for professional development and skill enhancement
Exposure to cutting-edge technologies in data engineering
Flexible work arrangements
Access to modern tools and resources for project execution
Full Job Description
Position Description
The Software Engineer shall be responsible for creating and maintaining data workflows and automation pipelines using Apache Airflow. This role focuses on building reliable, scalable, and observable workflow orchestration solutions that support data engineering, analytics, and operational use cases. The engineer will collaborate closely with data engineers, platform teams, and stakeholders to ensure workflows are efficient, secure, and production ready.
Position Required Skills
§ Experience using the Linux CLI and Linux tools
§ Experience developing Bash scripts to automate manual processes
§ Recent software development experience using Python and Java
§ Familiar with workflow orchestration tooling such as Apache Airflow
§ Familiar with Distributed Big Data processing engines such as Apache Spark
§ Experience with containerization technologies such as Docker, containerd, and Podman
§ Experience with Git Source Control System
Position Desired Skills
§ Experience using the Atlassian Tool Suite (JIRA, Confluence)
§ Familiar with AWS Cloud Services and Infrastructure
