Full Job Description
Job Description
The principal function of the Associate Data Engineer is to build robust ETL/ ELT pipelines to make data available to Data Analysts, Data Scientists, and other internal business units. The Data Engineer will be responsible for coding and working through the development cycle of ETL/ELT jobs and BI reporting. They will understand business requirements and design optimal ETL/ELT process for data acquisition, transformation, and publication for ease of analysis.
The Data Engineer will follow agile development methodology for timely delivery of accurate data. They must have coding proficiency to write unit tests for pipeline functionality as well as data quality - this includes job monitoring, alerting, and code versioning and deployment. This position is also expected to develop, modify, and deploy formal and ad hoc reports.
Job Duties
Develops and builds ETL/ELT data pipelines for use in data analysis.
Creates and maintains optimal data pipeline architecture.
Keeps data separated and secure across multiple cloud environments.
Assembles large, complex data sets that meet functional and non-functional business requirements.
Delivers ad-hoc and analytical reports to internal users and teams.
Monitors and maintains ETL/ELT jobs and troubleshoots load issues.
Manages change requests/ticket queues for analytical reports and ETL/ELT jobs.
Performs data/technology discovery from new sources and third-party applications for data ingestion.
Creates complex reports and dashboards in Cognos and Tableau.
Ingests and transforms structured, semi-structured, and unstructured data from sources including relational databases, NoSQL, external APIs, JSON, XML, delimited files, and more.
Works and delivers in agile methodology for new development projects. Delivers efficient and effective solutions on time.
Performs other job-related duties as assigned.
KSAs
Ability to analyze and understand data sources and design a data model for data capture and ETL/ELT
Ability to identify bugs and apply fixes and check data quality via process/pipeline audits
Ability to work with team members, as well as cross-team for product delivery
Ability to work in an agile environment with timely delivery of ETL/ELT pipelines and reports
Ability to deal with a variety of variables under limited standardization
Ability to interpret various instructions
Ability to communicate clearly, effectively, and appropriately with all audiences
Ability to work independently, is self-motivated, and a strong team player
Use of industry best practices for code development, testing, implementation and documentation
Experience with relational SQL and NoSQL databases
Knowledge and experience with object-oriented/object function scripting languages, like Python, Java, and Scala
Knowledge and experience with big data tools, like Hadoop, Spark, Kafka, Databricks, etc.
Exposure to analytical reporting tools, preferably Cognos and Tableau
Knowledge and experience with Cloudera or Horton, Impala, Hive, AngularJS, HTML5, and CSS/LESS
Minimum Qualifications
Bachelor's Degree in Management Information Systems, Computer Science, or a related field
2 years of experience in Data Engineering, Data Integration, Big Data, Business Intelligence, or Software Engineering
Equivalent relevant experience performing the essential functions of this job may substitute for education degree requirements. Generally, equivalent relevant experience is defined as 1 year of experience for 1 year of education and is the discretion of the hiring manager.
Preferred Qualifications
Higher Education Domain Exposure
Job Description Disclaimer: This position description provides the major duties/responsibilities, requirements and working conditions for the position. It is intended to be an accurate reflection of the current position, however management reserves the right to revise or change as necessary to meet organizational needs. Other responsibilities may be assigned when circumstances require.
This position requires occasional travel of up to 20%, including required attendance at designated company summits (typically one to two per year). Additional travel may include conferences, visits to company locations, and other business-related events as needed. Additional travel may be assigned as needed to support business requirements.
Position & Application Details
Full-Time Regular Positions (classified as regular and working 40 standard weekly hours): This is a full-time, regular position (classified for 40 standard weekly hours) that is eligible for bonuses; medical, dental, vision, telehealth and mental healthcare; health savings account and flexible spending account; basic and voluntary life insurance; disability coverage; accident, critical illness and hospital indemnity supplemental coverages; legal and identity theft coverage; retirement savings plan; wellbeing program; discounted WGU tuition; and flexible paid time off for rest and relaxation with no need for accrual, flexible paid sick time with no need for accrual, 11 paid holidays, and other paid leaves, including up to 12 weeks of parental leave.
How to Apply: If interested, an application will need to be submitted online. Internal WGU employees will need to apply through the internal job board in Workday.
