Software Engineer II sought by REsurety, Inc. in Boston MA to perform the following duties: Responsible for the development and maintenance of a multi-hundred-terabyte data lake. Development and maintenance of proprietary algorithms for wind generation, solar generation, and marginal emission abatement. This includes support and execution to generate time-series data for tens of thousands of projects Performant data access to drive on-the-fly analysis of renewable generation value for front-end web applications. The goal of the Software Engineer II is to ensure a strong technical and data foundation to drive REsurety's product lines.
The specific responsibilities of the Software Engineer II will include:- Develop and maintain a multi-hundred-terabyte data lake, ensuring robust, scalable, and performant data storage to support renewable energy analytics.
- Design, build, and optimize data ingestion pipelines using advanced SQL and object-oriented Python programming, integrating diverse datasets efficiently.
- Implement and administer Snowflake data warehouse solutions, including SQL tuning, schema design, and performance optimization for fast data access.
- Manage secure user credential creation and role-based access controls, ensuring data security compliance.
- Automate deployment and infrastructure provisioning using Terraform, Docker, and other DevOps tools, aligning with Infrastructure-as-Code (IaC) principles.
- Design and maintain CI/CD pipelines for production deployments, ensuring reliable data delivery and feature rollouts.
- Support the development and maintenance of proprietary algorithms for wind and solar generation forecasts and marginal emission abatement calculations.
- Enable performant data access layers and APIs to support real-time front-end web applications for renewable generation value analysis.
Job Requirements: Bachelor's degree, or foreign equivalent in Data Analytics, and Development Operations or a related field and 4 years of Data Engineering experience,
One year of experience must include:- Object-oriented programming in Python.
- System integration and automation.
- Snowflake data warehouse expertise.
- Enabling downstream users and processes easy access to complicated data models
- Design and development of enterprise-level automation test platform.
Salary: $162,552 per year
#LI-DNI
