Job Summary
We are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team. This role will be instrumental in designing, developing, and maintaining robust and scalable data pipelines and infrastructure. The Lead Data Engineer will guide technical direction, mentor junior engineers, and collaborate with cross-functional teams to deliver data solutions that drive business insights and innovation.
Key Responsibilities
• Design, build, and optimize scalable and efficient data pipelines for batch and real-time data processing.
• Develop and maintain data models, schemas, and data warehouses to support analytical and reporting needs.
• Implement and manage data integration processes from various sources into our data platform.
• Ensure data quality, integrity, and security across all data systems.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions.
• Lead the technical design and architecture of data engineering projects.
• Mentor and guide junior data engineers, fostering a culture of technical excellence.
• Troubleshoot and resolve complex data-related issues.
• Stay abreast of emerging data engineering technologies and best practices.
• Develop and maintain documentation for data pipelines, processes, and architecture.
Required Qualifications
• Bachelor's degree in Computer Science, Engineering, or a related quantitative field, or equivalent practical experience.
• 5+ years of experience in data engineering, with a strong focus on building and managing data pipelines.
• Proven experience with cloud data platforms such as AWS (S3, Redshift, Glue, EMR), Azure (Data Lake Storage, Synapse Analytics, Data Factory), or GCP (Cloud Storage, BigQuery, Dataflow).
• Strong proficiency in SQL and experience with various database technologies (e.g., relational, NoSQL).
• Hands-on experience with programming languages commonly used in data engineering, such as Python, Scala, or Java.
• Experience with big data technologies like Spark, Hadoop, Kafka, or similar.
• Solid understanding of data warehousing concepts, ETL/ELT processes, and data modeling techniques.
• Experience with version control systems (e.g., Git).
• Excellent problem-solving and analytical skills.
• Strong communication and interpersonal skills, with the ability to explain technical concepts to non-technical audiences.
• 8 + Years of exp in Migration between iSeries(or any legacy DB), SAP CRM
• 3 + Years of Exp in Azure Cosmos DB with Synapse experience
• 4+ Years of exp in data migration, data quality assessments/reporting, Data cleansing and building frameworks around automated solutions
Notes
Mandatory Areas
Must Have Skills - Azure Data Engineer
Skill 1 - 8 + Years of exp in Migration between iSeries(or any legacy DB), SAP CRM
Skill 2 - 3 + Years of Exp in Azure Cosmos DB with Synapse experience
Skill 3- 4+ Years of exp in data migration, data quality assessments/reporting, Data cleansing and building frameworks around automated solutions
Good To have Skills -
Skill 1 - Yrs of Exp -N/A
Skill 2 - Yrs of Exp -N/A
Skill 3 - Yrs of Exp -N/A
Skill 4 - Yrs of Exp -N/A
Mandatory if Applicable
Domain Experience (If any ) - N/A
Must have Certifications -N/A
Prior experience - Y / N
Location - Issaquah, WA
Onsite Requirement - Y/N- Y
Number of days onsite - 3 Days
If Onsite - Office Address -
