Job Summary
The Python Data Engineer will design and develop scalable, reliable, and data-centric software applications supporting regulatory reporting of mortgage loan data. The role will work within a multi-skilled Agile team focused on modernization, automation, and cost-efficient solutions. This position will leverage Python, PySpark, AWS, Hadoop, Spark, and other Big Data technologies to develop data solutions, support legacy applications, provide production support, and drive innovative technical solutions. The role will also provide technical leadership, mentor junior engineers, evaluate new technologies, and collaborate with business and technology stakeholders.
Key Responsibilities
• Develop scalable and reliable data solutions to move data across multiple systems and sources in real-time and batch processing modes.
• Design and develop data-centric software applications using modern technologies and Agile development practices.
• Identify and implement innovative automation solutions within data engineering.
• Implement technical solutions using modern cloud technologies while supporting existing legacy applications.
• Collaborate with Product Owners, Scrum Masters, and other stakeholders to understand business requirements and establish strong partnerships.
• Develop solutions using Python, Hadoop, Spark, AWS, and other Big Data technologies and tools.
• Quickly evaluate new and legacy technologies and paradigms to support modernization and cutting-edge solutions.
• Support applications in production, including resolving defects and implementing enhancements.
• Investigate production defects, identify root causes, and develop appropriate solutions.
• Provide production support and communicate clearly regarding incident resolution.
• Lead projects and provide technical guidance and coaching to junior developers.
• Evaluate new technologies and develop proof of concepts to assess their applicability.
• Support the implementation of regulatory reporting product vision and communicate effectively with key partners.
Required Qualifications
• Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent work experience.
• 5+ years of experience delivering solutions across the Software Development Life Cycle.
• 5+ years of experience delivering Data Engineering solutions using Python, PySpark, and AWS.
• Experience with AWS services including S3, Glue, and EMR.
• Experience with Data Lake and Delta Lake technologies.
• 3+ years of experience working with complex SQL queries.
• 3+ years of experience working in a Unix environment.
• Experience leading or providing technical guidance to junior developers.
• Strong ability to quickly learn and understand new and legacy technologies.
• Strong interpersonal, technical, organizational, and communication skills.
• Ability to take accountability, establish expectations, and deliver high-quality technical solutions within agreed-upon timelines and effort.
• Ability to work effectively in a fast-paced and continuously evolving Agile environment.
Preferred Qualifications
• Experience with regulatory reporting applications and mortgage loan data.
• Experience with CI/CD and modern digital delivery practices.
• Experience driving automation and modernization initiatives.
• Experience evaluating emerging technologies through proof-of-concept development.
