Job Summary
We are seeking a hands-on Senior Data Engineer to join the Data Engineering and Analytics team, responsible for building and maintaining enterprise data infrastructure supporting analytics initiatives, external report and dataset builders, self-service reporting, and AI consumption. The role requires strong expertise in Snowflake, SQL, Python, dbt, Snowpark, and Snowflake Cortex capabilities. The ideal candidate will have experience developing LLM-based agents, building governed and trustworthy data solutions, and implementing dimensional data models. The candidate must be able to independently manage Jira stories from requirements gathering and development through validation, code review, and production deployment while collaborating directly with Product Owners and technical stakeholders.
Key Responsibilities
• Develop and maintain enterprise-scale data solutions using Snowflake, SQL, Python, Snowpark, and dbt.
• Work with Snowflake Cortex Agents, Cortex Analyst, and Cortex Search to support AI-driven data consumption.
• Develop and maintain integrations using Snowflake MCP to support AI and LLM use cases.
• Design, develop, deploy, and maintain LLM-based agents using Python.
• Build Snowpark Python stored procedures and support advanced data processing requirements.
• Develop dbt models, semantic models, and views to support trusted and governed data consumption.
• Design and build dimensional data models using facts, dimensions, and Star Schema/Kimball methodology.
• Create reliable Snowflake datasets that support MCP integrations consumed by Claude, enabling users to ask business questions and receive accurate answers based on structured data.
• Build datasets supporting Product teams, product curators, external reporting, and self-service analytics.
• Independently manage Jira stories from requirements gathering through development, validation, testing, pull requests, code reviews, and production deployment.
• Collaborate directly with Product Owners and technical stakeholders to gather requirements and define development priorities.
• Implement and maintain GitHub-based CI/CD pipelines using GitHub Actions and Snowflake CLI.
• Manage Dev-to-Production deployments for dbt and Snowflake changes.
• Work with Snowpark Container Services, Docker, and compute pools to support containerized workloads.
• Evaluate and review AI agent-generated dbt code to ensure quality and accuracy.
• Develop and validate code, raise Git pull requests, and address feedback from architectural reviews.
• Strengthen accountability around data validation, testing, and code quality.
• Take ownership of periodic production support responsibilities and respond to production issues.
Required Qualifications
• 8+ years of experience as a Senior Data Engineer.
• Strong hands-on experience with Snowflake Cortex Agents, Cortex Analyst, Cortex Search, MCP, and Snowpark.
• Strong Python development experience, including LLM and agent development.
• Experience designing, developing, deploying, and maintaining LLM-based agents.
• Experience developing Snowpark Python stored procedures.
• Strong hands-on experience with SQL and dbt development.
• Experience developing semantic models and views.
• Strong understanding of data warehousing and dimensional modeling, including facts, dimensions, and Star Schema/Kimball methodology.
• Experience implementing GitHub-based CI/CD using GitHub Actions and Snowflake CLI.
• Experience managing Dev-to-Production deployments for Snowflake and dbt changes.
• Working knowledge of Snowpark Container Services, Docker, and compute pools.
• Ability to independently manage Jira stories through requirements, development, validation, testing, code review, and production deployment.
• Ability to evaluate and review agent-generated dbt code.
• Strong communication skills and the ability to collaborate effectively with Product Owners and technical stakeholders.
• Strong analytical, problem-solving, and data validation skills.
Preferred Qualifications
• Experience with Sigma.
• Experience retrieving and integrating data from APIs.
• Experience with Matillion.
