Job DescriptionThe Data Engineer analyzes complex and unstructured data using advanced data engineering techniques to develop and maintain data and deployment pipelines. This role uses knowledge of data processing, prototyping, and architecture methods to help solve real-world problems. The Data Engineer will work with Data Scientists and internal/external customers to collect and understand diverse types of data, perform wrangling, and develop and integrate applications at scale.
What You Will Do: - Utilize knowledge of modern data-driven methods and domain understanding to support the creation of new products, services, and insights using predictive models.
- Write independent source code, validate, and test for model quality improvement.
- Utilize machine learning, artificial intelligence, classification, regression, NLP, etc.
- Data analysis using Python, Database Systems (such as SQL), and Azure cloud tools to contribute towards solving data analytics problems.
- Perform data wrangling and processing from multiple databases (structured or unstructured data) with a keen eye for data quality.
- Use DevOps Repo to build, manage and optimize data pipelines and deploy these pipelines into production
- Assist in developing and using tools like Python libraries and visualization.
- Remain current in the field of advanced analytics and take initiative to apply new technologies.
What You Will Need:Education and Experience
- BS degree required; MS preferred in Data Engineering, Computer Engineering, Computer Science, Engineering, or another relevant field
- Typically requires 3-4 years of relevant experience in data analytics as a data engineer (or applied scientist role)
Knowledge, Skills, and Abilities
- Experience in using Machine Learning, Ai, and other data science technologies.
- Strong and demonstrable experience with programming languages such as Python (used NumPy, pandas, etc.).
- Strong knowledge of data architectures and systems - SQL and others for ETL purposes.
- Strong knowledge of DevOps, particularly using the Repo and pushing and pulling source code with versioning.
- Ability to work with MS Azure cloud tools.
- Intermediate C# and Power Shell scripting skills.
- Good skills in using Web APIs and XML.
- Experienced in using tools such as MS Power BI, Tableau, or other visualization tools.
- Knowledge of object-oriented programming and building RESTful APIs for data science modeling.
- Display an entrepreneurial mindset and think of practical, 'out of box' solutions.
- Ability to work efficiently and deliver timely in a fast-paced environment.
- Obtain a working knowledge of the ABS Health, Safety, Quality, and Environmental Management System.
Reporting Relationships:The incumbent reports directly to the Chief Data Scientist in Global Technology or other management or executive level positions. May have individual contributor direct reports.
