Job Description
Data Engineer
Duties:
Apply proven expertise and build high-performance, scalable data warehouse application
Securely source external data from numerous global partners
Intelligently design data models for optimal storage and retrieval
Deploy inclusive data quality checks to ensure high quality of data
Optimize existing pipelines and implement new ones, maintenance of all domain-related data pipelines
Ownership of the end-to-end data engineering component of the solution
Collaboration with the program's SMEs, data scientists
Data Engineer will rotate on an On-Call shift as needed to support the team.
Skills:
5+ years' experience in data engineering, proven expertise of applying DWH/ETL best practices
proficiency in LAMP and the Big Data stack environments (Hadoop, MapReduce, Hive)
competence with relational databases (Oracle, MySQL)
experience working with enterprise DE tools, ability to learn in-house DE tools quickly
coding and scripting experience with Python, Java, PHP, SQL, CLI
Keywords:
Education:
BS/MS in Computer Science or a related technical field
Skills and Experience:
Required Skills:
CODING
ENGINEER
ETL
HIVE
MYSQL
Additional Skills:
SCRIPTING
SQL
APACHE HADOOP MAPREDUCE
DATA MODELS
DATA QUALITY
DATA WAREHOUSE
DATABASE
DATABASES
EXTRACT, TRANSFORM, AND LOAD
HADOOP
LAMP
LAMP STACK
MAINTENANCE
MAPREDUCE
ORACLE
QUALITY CHECKS
Qualifications
Additional Information
