Job Description:This job is responsible for driving efforts to develop and deliver complex data solutions to accomplish technology and business goals. Key responsibilities include leading code design and delivery tasks with the integration, cleaning, transformation and control of data in operational and analytical data systems. Job expectations include liaising with vendors and working with stakeholders and Product and Software Engineering teams to implement data requirements, analyzing performance, and researching and troubleshooting issues within system engineering domains.
EBIT is looking for a Starburst Platform Support Data Engineer to support Starburst platform onboarding activities, platform monitoring, incident management, and GenAI enablement initiatives. Assist senior engineers with platform maintenance activities, catalog configuration, connectivity validation, production monitoring, troubleshooting, and documentation. Work closely with application teams to ensure successful onboarding and operational stability of the Starburst shared platform.
Responsibilities:- Leads story refinement and delivery of requirements through the delivery lifecycle and assists team members in resolving technical complexities
- Codes complex solutions to integrate, clean, transform, and control data, builds processes supporting data transformation, data structures, metadata, data quality controls, dependency, and workload management, assembles complex data sets, and communicates required information for deployment
- Leads documentation of system requirements, collaborates with development teams to understand data requirements and feasibility, and leverages architectural components to develop client requirements
- Leads testing teams to develop test plans, contributes to existing test suites including integration, regression, and performance, analyzes test reports, identifies test issues and errors, and leads triage of underlying causes
- Leads work efforts with technology partners and stakeholders to close gaps in data management standards adherence, negotiates paths forward by thinking outside the box to identify and communicate solutions to complex problems, and leverages knowledge of information systems, techniques, and processes
- Leads complex information technology projects to ensure on-time delivery and adherence to release processes and risk management and defines and builds data pipelines to enable data-informed decision making
- Mentors Data Engineers to enable continuous development and monitors key performance indicators and internal controls
- Support onboarding of new Starburst data products.
- Perform platform health monitoring and reporting.
- Assist with incident troubleshooting and ticket management.
- Validate catalogs, connectors, and user access.
- Create operational documentation and runbooks.
- Assist in dashboard and monitoring setup.
- Support GenAI data access and validation activities.
- Support new tenants onboarding
- Supporting data products within AMI
- AIDA support within Starburst within AMI
Required Qualifications:- Bachelor's degree in computer science/data engineering.
- Starburst knowledge
- kubernetes/containers
- YAML
- openshift
- hadoop
- SQL knowledge.
- Basic Linux experience.
- Understanding of databases and data warehousing.
- Basic Python programming.
- Good verbal and written communication skills.
Desired Qualifications:- Full understanding of images/containers/kubernetes/YAML file/BIACs 3+ years
- Starburst experience and skills as Admin and DEVOPs ability to mult-task and work with multiple groups/users/teams etc
Skills:- Analytical Thinking
- Application Development
- Data Management
- DevOps Practices
- Solution Design
- Agile Practices
- Collaboration
- Decision Making
- Risk Management
- Test Engineering
- Architecture
- Business Acumen
- Data Quality Management
- Financial Management
- Solution Delivery Process
Shift:1st shift (United States of America)
Hours Per Week: 40
Pay Transparency detailsUS - NJ - Jersey City - 101 Hudson St - 101 Hudson (NJ2101)
Pay and benefits information
Pay range
$104,000.00 - $157,700.00 annualized salary, offers to be determined based on experience, education and skill set.
Discretionary incentive eligible
This role is eligible to participate in the annual discretionary plan. Employees are eligible for an annual discretionary award based on their overall individual performance results and behaviors, the performance and contributions of their line of business and/or group; and the overall success of the Company.
Benefits
This role is currently benefits eligible. We provide industry-leading benefits, access to paid time off, resources and support to our employees so they can make a genuine impact and contribute to the sustainable growth of our business and the communities we serve.
