Main purpose
The Data Engineer will be responsible for building and maintaining the data integration infrastructure that underpins Trafigura's North American Gas and Power trading desk. Working within the Data Science and Engineering team, this role ensures that critical data flows reliably and on time across internal and external systems, directly enabling commercial decision-making and process automation.
Key responsibilities
- Design, build, and maintain time-critical data integration pipelines (ETL/ELT) across a range of internal and external data sources.
- Develop and maintain data models appropriate to the variety of datasets flowing through the integration layer.
- Implement and manage cloud-based data integration solutions on AWS, leveraging services such as S3, Glue, Lambda, and Redshift.
- Monitor, troubleshoot, and optimise existing pipelines to ensure reliability, performance, and data quality.
- Contribute to the automation of data workflows on the trading desk, reducing manual intervention and operational risk.
- Develop a solid understanding of the desk's data landscape and commercial requirements in order to deliver integration solutions that meet business needs.
Required qualifications
- Minimum 3 years' experience in Python and SQL, with a focus on data integration or pipeline development, including experience with relational databases and data modelling.
- Hands-on experience with cloud data services (e.g. AWS, Azure, or GCP), containerisation (e.g. Docker, Kubernetes), and Infrastructure as Code (e.g. Terraform, CloudFormation).
- Experience monitoring, observing, and debugging data pipelines, including the use of logging, alerting, and observability tooling (e.g. CloudWatch, Grafana).
- Proficient in the use of AI assistant tools to support and accelerate development workflows (e.g. GitHub Copilot, Claude, or equivalent).
- Bachelor's degree in Computer Science, Data Science, or a related STEM field.
Preferred qualifications
- AWS certifications (e.g. AWS Certified Data Engineer, Solutions Architect).
- Experience with NoSQL databases.
- Familiarity with streaming or event-driven data integration patterns.
- Prior exposure to Gas and/or Power trading environments.
Attributes for success
- Detail-oriented with a strong sense of ownership over data quality and pipeline reliability.
- Clear communicator, able to engage both technical and commercial stakeholders.
- Comfortable working under pressure in a time-sensitive trading environment.
- Proactive and eager to develop a deep understanding of the business context behind the data.
Department overview
The Data Science and Engineering team researches, develops, and delivers sophisticated analytics, data services, and applications to Trafigura's trading business and broader commercial operations. The team supports Trafigura's North American Gas and Power desk, which manages both physical and derivative portfolios and is heavily dependent on timely, high-quality data integration to support trading activity and process automation. The successful candidate will work closely with traders and commercial stakeholders, building expertise in the desk's data ecosystem while taking ownership of critical integration pipelines and workflows.
