Responsibilities We are seeking an experienced Data Engineer to join the Neptune North engineering team.
This role involves building and maintaining scalable data intensive systems, pipelines and platforms that support advanced analytics and modelling for clients. You will work closely with data scientists, consultants, and clients to enable impactful decision-making by ensuring data is available, reliable and of high quality.
Key Expectations:- Data Pipeline Development: Design and develop sophisticated data pipelines to import data from internal and external sources and seamlessly integrate into data platforms.
- Development & Testing: Contribute to existing and new data products to ensure they align with ever-changing business requirements. Test systems regularly to confirm their effectiveness and perform troubleshooting when necessary.
- Maintenance & Data Reliability: Ensure systems are well-maintained, enabling uninterrupted access to crucial data. Continuously verify data quality and integrity to support decision making.
- Continuous Improvement & Collaboration: Collaborate with internal and external stakeholders to streamline data accessibility and usability. Drive innovation by adopting advanced analytics technologies and methodologies.
What makes a great candidate - 3-6 years of experience as a data engineer or a related role
- Minimum 3.3 GPA degree obtained in Computer Science or a quantitative field, ideally from a top-ranked University.
- Expertise in designing and building data intensive applications and pipelines, with an open mindset on choice of tools
- Proficiency in one or more programming languages, including Python and SQL.
- Experience in some or all of:
- Distributed computing for data intensive work such as Spark and Databricks
- Cloud platforms including AWS, Azure, and GCP
- Orchestration tools like Airflow
- Modern development practices including version control, CI/CD, and infrastructure as code
- Ability to test and troubleshoot data products with a track record of improving data reliability and quality
- Excellent communication skills and the ability to work effectively and openly within a team-based environment
- Self-motivated, detail-oriented, and eager to learn new technologies and methodologies
- Interest and experience in financial services, risk management, or consulting is beneficial