Job Summary
The Senior Data Migration Engineer will serve as a hands-on technical contributor responsible for designing and implementing Python-based extraction and loading pipelines, dbt-based transformation models, and Airflow-based orchestration for large-scale data migration from Informatica PowerCenter to a modern data stack. The role requires expertise in translating complex Informatica workflows into Python, dbt, and Airflow solutions while ensuring production-quality, functionally equivalent outputs at enterprise scale.
Key Responsibilities
• Assess complex Informatica workflows, including sessions, mappings, and parameterizations, and translate them into equivalent Python extraction and loading scripts and dbt transformation models.
• Develop and maintain Python extraction and loading pipelines to transfer high-volume data, including billion-row tables, into the target warehouse using SQLAlchemy, cx_Oracle, pyodbc, and bulk export tools such as Oracle Data Pump and SQL Server BCP.
• Design and develop dbt transformation models based on Informatica mapping logic, following best practices for model layering, macros, incremental strategies, and snapshot patterns.
• Develop dbt-native tests and custom Python unit tests to validate transformation correctness and data quality.
• Develop Airflow DAGs to orchestrate Python extraction and loading pipelines and dbt scripts, ensuring outputs are functionally equivalent to the source Informatica workflows.
• Contribute to GitLab CI/CD pipelines for dbt and Airflow code, including linting gates, automated testing, and deployment to shared network-attached storage (NAS).
• Perform peer code reviews and provide constructive technical feedback to fellow engineers.
• Troubleshoot performance issues and data discrepancies during System Integration Testing (SIT) and User Acceptance Testing (UAT), including row-count reconciliation between source Oracle/SQL Server systems and the target warehouse.
• Contribute to technical documentation, operational runbooks, and handover materials.
Required Qualifications
• 5+ years of experience with Informatica PowerCenter, including mappings, sessions, workflows, and parameterization.
• 3+ years of hands-on experience with dbt Core, including model layering, macros, tests, and incremental materializations.
• Experience with Apache Airflow, including DAG authoring, task dependencies, and integration with scheduling tools.
• 5+ years of Python experience, including production use of parallelism and batch data processing.
• 5+ years of SQL experience, including complex joins, window functions, and aggregations across large datasets.
• Experience with Oracle Data Pump (expdp/impdp) or SQL Server BCP/BULK INSERT for high-volume data movement.
Preferred Qualifications
• Experience with SQLAlchemy, cx_Oracle, or pyodbc for Python-based database connectivity.
• Experience mentoring junior and mid-level engineers in offshore delivery models.
