Job Summary
The AWS Snowflake Architect will lead data architecture and engineering initiatives, designing and implementing scalable data solutions using Snowflake on AWS. The role involves architecting large-scale data transformation programs, developing and orchestrating ETL/ELT pipelines, implementing modern data architectures, and optimizing data platforms for performance, cost, and scalability. The architect will support legacy platform migrations, data governance, data quality, and the development of data products leveraging Snowflake ML and LLMOps capabilities.
Key Responsibilities
• Design and implement advanced data solutions using Snowflake on AWS, supporting large-scale data transformation programs.
• Design and orchestrate data acquisition pipelines using AWS Glue, Snowflake Openflow, and Apache Airflow to enable seamless ingestion from diverse data sources.
• Implement dbt to manage and automate complex data transformations within Snowflake, ensuring modular, testable, and version-controlled transformation logic.
• Implement lakehouse solutions using the Medallion architecture for financial services or insurance data platforms.
• Optimize and tune Snowflake environments for performance, cost, and scalability, including query optimization and resource management.
• Architect and lead the migration of data workloads from Cloudera to Snowflake.
• Design Streamlit applications and define new capabilities and data products leveraging Snowflake ML and LLMOps capabilities.
• Evaluate data technology platforms, including data governance suites and data security products.
• Develop robust data models and pipelines to support data transformation across multiple sources while ensuring data quality and integrity.
• Document architecture, data flows, and transformation logic to support transparency, maintainability, and knowledge sharing across teams.
• Apply data lifecycle management, data retention, and data modeling practices in cloud-based environments.
• Support data governance, metadata management, and data quality initiatives using frameworks and tools such as Collibra and Informatica.
• Support policy and data conversion from legacy platforms to modern data platforms.
• Evaluate and work with enterprise data warehouse technologies, including Cloudera, AWS Redshift, and Informatica toolsets such as IDMC, PowerCenter, and BDM.
Required Qualifications
• 8+ years of experience in data architecture and engineering, with a proven track record in large-scale data transformation programs.
• Extensive hands-on experience architecting and implementing enterprise data solutions using Snowflake on AWS.
• Hands-on experience with AWS Glue for ETL/ELT, Apache Airflow for orchestration, and dbt for data transformation, preferably deployed on AWS ECS.
• Proficiency in SQL, data modeling, ETL/ELT processes, and scripting languages such as Python or Java.
• Strong understanding of data lifecycle management, data retention, data modeling, cloud computing, and modern development practices.
• Experience implementing data governance, metadata management, and data quality frameworks.
• Experience architecting and implementing lakehouse solutions using the Medallion architecture.
• Experience optimizing Snowflake performance, resource utilization, cost, and scalability.
• Experience leading migrations from Cloudera to Snowflake.
• Experience evaluating enterprise data warehouse platforms, data governance suites, and data security products.
• Experience converting policy and data from legacy platforms to modern platforms.
Preferred Qualifications
• Experience in the insurance or financial services industry.
• Experience with Snowflake Openflow, Snowflake ML, LLMOps, and Streamlit application development.
• Exposure to enterprise data warehouse solutions such as Cloudera and AWS Redshift.
• Experience with Informatica tools, including IDMC, PowerCenter, and BDM.
• Experience with data governance and metadata management tools such as Collibra and Informatica.
• SnowPro Advanced certification.
