Lead Data Platform Engineer

Sr. Lead Engineering, you will be responsible for leading a team of skilled engineers in designing, building, and maintaining our organization's data platform and hydrating the data on enterprise data cloud platform. This critical platform serves as the foundation for data storage, processing, and analysis, enabling data-driven decision-making across the company. Your role will involve overseeing the development of scalable, reliable, and performant data solutions that support the needs of various business units and stakeholders.

Key Responsibilities and Duties

• Lead and mentor a team of data engineers, fostering a collaborative and innovative environment.

• Set clear objectives, provide performance feedback, and support professional development to ensure team success.

• Collaborate with cross-functional teams to define the data platform's architectural vision and align it with the organization's data strategy.

• Evaluate and select appropriate technologies and tools to enhance the platform's capabilities and efficiency.

• Oversee the design and implementation of data pipelines, ensuring smooth and efficient data ingestion from various sources.

• Guarantee data quality and integrity throughout the data integration process.

• Ensure the design and implementation of scalable and optimized data storage solutions (data warehouses, data lakes, etc.).

• Implement data retention policies and oversee data archival processes.

• Manage the development of data processing workflows to enable data transformation and enrichment.

• Optimize data processing pipelines to minimize latency and maximize performance.

• Work with the security team to implement data access controls, encryption, and other data protection measures.

• Ensure compliance with data privacy regulations and industry best practices.

• Implement monitoring and alerting systems to proactively identify and address potential data platform issues.

• Continuously optimize the platform's performance and scalability to handle increasing data volumes.

• Collaborate with stakeholders, data scientists, and analysts to understand their requirements and provide data platform solutions that meet their needs.

• Effectively communicate technical concepts and project updates to non-technical stakeholders.

Educational Requirements

• University (Degree) Preferred

Work Experience

• 5+ Years Required; 7+ Years Preferred

Physical Requirements

• Physical Requirements: Sedentary Work

Career Level
8IC

Required Skills:

• 5+ years’ experience on Data Engineering or Data Pipeline
• 4+ years’ experience in SQL Data Modeling
• 2+ years of python development experience
• Bachelor’s or master’s degree in computer science, Engineering, or a related field.
• Experience with big data technologies, such as Hadoop, Spark, Kafka, and cloud-based data services  like AWS.
• Strong expertise in data architecture, data integration, and data processing techniques.

Preferred Skills:

• Proven experience as a manager, leading data engineering teams in designing and building data platforms.
• Experience in data security best practices and data privacy regulations.

Anticipated Posting End Date:

Actual base salary may vary based upon, but not limited to, relevant experience, time in role, base salary of internal peers, prior performance, business sector, and geographic location.  In addition to base salary, the competitive compensation package may include, depending on the role, participation in an incentive program linked to performance (for example, annual discretionary incentive programs, non-annual sales incentive plans, or other non-annual incentive plans). 

_____________________________________________________________________________________________________