Job Summary
The Data Engineer / ETL Developer will develop, support, and maintain ETL solutions using Apache NiFi, PySpark, and AWS Glue. The role requires strong expertise in SQL query development and performance tuning, along with experience working with MySQL, PostgreSQL, and AWS DocumentDB. The developer will support data integration and streaming solutions, provide development and production support for GBD/RX, regular projects, and Knox initiatives, troubleshoot production issues, perform root cause analysis (RCA), and coordinate system integration testing, regression testing, and data validation.
Key Responsibilities
• Develop and maintain ETL solutions using Apache NiFi, PySpark, and AWS Glue.
• Write, optimize, and troubleshoot complex SQL queries and perform database performance tuning.
• Work with MySQL, PostgreSQL, and AWS DocumentDB to support data processing and integration requirements.
• Work with Apache Kafka or similar streaming platforms to support data streaming and integration workflows.
• Provide development and production support for GBD/RX, regular projects, and Knox initiatives.
• Troubleshoot production issues, perform root cause analysis (RCA), and implement corrective fixes.
• Coordinate and execute system integration testing (SIT), regression testing, and data validation.
• Collaborate with relevant teams to resolve data processing issues and ensure reliable ETL operations.
Required Qualifications
• Strong hands-on experience with Apache NiFi, PySpark, and AWS Glue for ETL development.
• Expertise in complex SQL queries and database performance tuning.
• Experience working with MySQL, PostgreSQL, and AWS DocumentDB.
• Good knowledge of Apache Kafka or similar streaming platforms.
• Experience providing development and production support for data engineering initiatives.
• Experience troubleshooting production issues, performing root cause analysis, and implementing fixes.
• Experience coordinating and executing system integration testing, regression testing, and data validation.
Notes:
Mandatory Areas
Must Have Skills - Data Engineer / ETL Developer
Skill 1 - 6 + Years of exp in Apache NiFi, PySpark, and AWS Glue for ETL development
Skill 2 - 6 + Years of Exp in complex SQL queries, performance tuning, MySQL, PostgreSQL, and AWS DocumentDB
Skill 3- 3+ Years in Apache Kafka or similar streaming platforms
Good To have Skills -
Skill 1 - Yrs of Exp -N/A
Skill 2 - Yrs of Exp -N/A
Skill 3 - Yrs of Exp -N/A
Skill 4 - Yrs of Exp -N/A
Mandatory if Applicable
Domain Experience (If any ) - N/A
Must have Certifications -N/A
Location - Mason, OH (onsite)
Onsite Requirement - Yes
Number of days onsite - 5 days a week
If Onsite - Office Address - Mason, OH
