Job Summary: As a Senior Director, Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support our data-driven initiatives. You will collaborate closely with cross-functional teams to ensure the availability, reliability, and performance of our data systems and solutions.
Responsibilities:- Design, implement, and optimize data pipelines for large-scale structured and unstructured data.
- Develop robust Extract Transform Load (ETL) processes for integrating diverse data sources.
- Support operations and production data eco system as a primary point of contact.
- Ensure data accuracy through validation and quality checks.
- Design and maintain data models, schemas, and database structures.
- Optimize storage and retrieval for performance and scalability.
- Evaluate and implement relational, NoSQL, data lake, and cloud storage solutions.
- Build and maintain integrations with internal/external data sources and APIs.
- Develop RESTful Application Programming Interface (API) and web services for data access.
- Ensure system compatibility and interoperability.
- Configure and manage databases, warehouses, lakes, and distributed frameworks.
- Monitor performance, troubleshoot, and optimize for reliability and efficiency.
- Implement data security and access controls.
- Work with stakeholders to understand requirements and deliver solutions.
- Document designs, workflows, and best practices for knowledge sharing.
- Provide technical guidance and support to team members.
Required Qualifications:- Bachelor's degree in Computer Science, Engineering, Information Systems, or related field.
- 9+ years experience in data engineering, software development, or related roles.
- 9+ years in programming languages commonly used in data engineering (e.g., Python, Java, Store procs, Structured Query Language (SQL), Scala, etc.).
- Strong knowledge of database systems, data modeling techniques, and SQL proficiency.
- Proficiency with ETL tools commonly used in data engineering (e.g., Sequel Server Information Systems (SSIS), Snowflake, Databricks, Azure Data
- Factory, Store procs).
- Experience with big data technologies and frameworks (e.g., Hadoop, Spark, Kafka, etc.).
- Experience with cloud platforms and services (e.g., Amazon Web Services (AWS), Azure, Google Cloud Platform, etc.).
- Excellent problem-solving skills and attention to detail.
- Effective communication and collaboration skills in a team-oriented environment.
- Ability to adapt to evolving technologies and business requirements.
