Job Description:

Position Description:

Designs and implements scalable data pipelines, optimizes workflows for performance and reliability, and ensures compliance with data governance policies. Programs testable and maintainable software solutions using Object Oriented (OO) Python programming and Machine Learning (ML) libraries, including Pandas, NumPy, Scikit-learn, and TensorFlow. Develops and designs functional programming, emerging technologies, and messaging frameworks, using Kafka. Implements business rule management systems in Python or Java with Drools, Pyke, and Nools. Leverages quantitative, statistics, and econometrics (including probability, linear regression, time series data analysis, and optimizations) techniques and methods. Programs testable and maintainable software solutions using Splunk, Snowflake, YugabyteDB, Aerospike, and S3 database management systems. Employs Agile development lifecycle methodologies (Kanban and SCRUM).

Primary Responsibilities:

• Develops software system testing and validation procedures, programming, and documentation.

• Develops original and creative technical solutions to on-going development efforts.

• Designs applications or subsystems on major projects and for/in multiple platforms.

• Performs technical and functional analysis for data engineering projects.

• Supports and performs all phases of testing leading to implementation.

• Develops comprehensive documentation for multiple applications supporting several corporate initiatives.

• Responsible for post-installation testing of any problems.

• Establishes project plans for projects of moderate scope.

• Works on complex assignments and often multiple phases of a project.

• Collaborates with teams to support data-centric initiatives.

• Performs independent and complex technical and functional analysis for multiple projects supporting several initiatives.

Education and Experience:

Bachelors degree in Computer Science, Engineering, Information Technology, Information Systems, or a closely related field (or foreign education equivalent) and three (3) years of experience as a Senior Data Engineer (or closely related occupation) architecting, building, deploying, and monitoring real-time and batch pipelines for data engineering in a financial services environment.

Or, alternatively, Masters degree in Computer Science, Engineering, Information Technology, Information Systems, or a closely related field (or foreign education equivalent) and one (1) year of experience as a Senior Data Engineer (or closely related occupation) architecting, building, deploying, and monitoring real-time and batch pipelines for data engineering in a financial services environment.

Skills and Knowledge:

Candidate must also possess:

• Demonstrated Expertise (DE) performing cloud-native, event-driven, data platform architecture using Amazon Web Services (AWS) (Lambda, Glue, EC2, EMR, Athena, and Crawler), PySpark, Kafka, and Airflow in enterprise environments.

• DE building and optimizing data lakes, warehouses, and models, using Snowflake, Redshift, SQL, and Denodo to access federated databases (Oracle, DB2, Teradata, MongoDB, PostgreSQL, MSSQL, Yugabyte, and Aerospike); and enabling scalable transformations, performance tuning, and cross-platform insights.

• DE developing Continuous Integration and Continuous Delivery (CI/CD) pipeline development and data workflow orchestration, using Airflow, Control-M, Jenkins, SQL, Python, Terraform, and Docker within the Software Development Life Cycle (SDLC), to automate ingestion, transformation, validation, and monitoring for data integrity, Agile delivery, and operational efficiency.

• DE performing Extract Transform Load /Extract Load Transform (ETL/ELT) for predictive modeling and analytics, using Python, Pandas, Scikit-learn, TensorFlow, and Snowpark; generating insights using PowerBI, Tableau, or Quicksight; and developing scalable solutions using Java, Shell, PL/SQL, Talend, Alteryx, Informatica, Unix, and Linux.

#PE1M2

#LI-DNI

Certifications:

Category:Information Technology