Client is seeking a talented and motivated Senior Data Engineer to join their Data and
Analytics team. Client is constantly enhancing their Data Engineering Platform for business and
operational analytics. At client, they have state of the art technologies such as Oracle Fusion,
Sales Force, Adobe to name a few. The Data platform will allow users to answer "what, "when
and "how questions and allow them to ask "what if. You should be passionate about solving
business problems using data. Integrating data from disparate sources to find hidden gems
should be your second nature. You will be part of the team that is driven by data driven culture
Responsibilities
Design, build and maintain all facets of the Data Pipelines for Data Engineering team.
Develop collaborative relationships and work with key business sponsors and other IT
teams to solve complex problems with simple solutions
Lead the development of ETL processes to integrate data from a wide variety of sources
including S3 objects, Kafka, REST APIs, SQL Server
Continue refining the Python data management framework developed internally
Enhance existing data centric CI/CD framework utilizing BitBucket and Jenkins
Ensure established standards are followed for code deployment between environments
Participate in architecture design sessions and perform code reviews
Follow and improve the established standards for design, development, and migration
Mentor junior team members
Qualifications
Degree in Computer Science, Information Systems, Information Technology, or related
engineering field
Five + years experience as a Data Engineer or as a Data Lake Architect on AWS
platform
Required experience
Deep knowledge of AWS Services such as S3, EMR, Redshift, DataPipeline,
RDS, DynamoDB, STEP functions, Lambda
Advanced SQL knowledge for Redshift
ETL process design and implementation on AWS
Jenkins, Bitbucket, Webhooks
Containerized workload management using Docker
Streaming data processing (Kafka)
Location: NYC
Duration: FTE
Salary: DOE
Work Authorization: No visa sponsorship at this time
