Manager, Enterprise Data Engineer, Galaxy US Opco Inc., New York, NY. Help organizations to design, develop and implement data pipelines and architectures to support enterprise data initiatives. Support the development and optimization of ETL/ELT processes for data integration from diverse structured and unstructured sources. Ensure data quality, consistency, and governance across the data platform in accordance with organizational standards and compliance requirements. Utilize big data and cloud to build and manage enterprise-grade data solutions. Collaborate with team to support analytics, reporting, and machine learning initiatives with reliable and timely data delivery. Supervise and Coach team.
40 hrs/week, Mon-Fri, 8:30 a.m. - 5:30 p.m. Salary: $125,000 - $225,000/yr. VNY01
MINIMUM REQUIREMENTS:
Must have a Bachelor's degree or foreign equivalent in Management Information Systems, Engineering, Business Administration, or a related field, plus 5 years of progressive, post- bachelor's related work experience.
In the alternative, the employer will accept a Master's degree or foreign equivalent in Management Information Systems, Engineering, Business Administration, or a related field, plus 3 years of related work experience.
Must have at least one year of experience with each of the following:
• Designing and implementing the architecture for the Enterprise Data Platform, focusing on CI/CD pipelines for applications and integrating Azure Data Factory pipelines to enable seamless data movement between enterprise systems like ADLS and Snowflake;
• Utilizing Python / Power-shell skills to script jobs to automate the routine tasks such as scheduled maintenance and dynamic scale up of resources by using Azure Server less services to optimize the cost of running such utilities;
• Ensuring that all the automated build and deploy pipelines (CI/CD) are working without any issues and remediating issues immediately with minimal impact to services; and
• Deploying GPT based artificial intelligence models in Azure Open AI service and monitoring the parameters such as token count, cost of operation, also working with other Azure AI tools such as Search Service, Document Intelligence, Text analytics etc.
100% telecommuting permitted.
Domestic and/or international travel up to 25% of the time is required.
Multiple Positions Available.
