Job SummaryWe are seeking an experienced AWS Snowflake Architect with 12+ years of expertise in data architecture and engineering to lead enterprise-scale data transformation initiatives. The ideal candidate will possess deep knowledge of Snowflake on AWS, modern data engineering practices, cloud-native architectures, and data migration strategies. This role involves designing scalable data platforms, implementing robust data pipelines, optimizing Snowflake environments, and enabling advanced analytics and machine learning capabilities.
Key Responsibilities- Architect and implement enterprise-scale data solutions using Snowflake on AWS.
- Design and orchestrate data acquisition pipelines using AWS Glue, Snowflake OpenFlow, and Apache Airflow for seamless ingestion of data from diverse sources.
- Develop and automate complex data transformations using dbt, ensuring modular, testable, and version-controlled transformation logic.
- Design and implement Lakehouse solutions utilizing the Medallion Architecture for financial services or insurance organizations.
- Optimize Snowflake environments for performance, scalability, and cost efficiency through query tuning and resource management.
- Lead the migration of enterprise workloads from Cloudera to Snowflake.
- Design Streamlit applications and develop new data products leveraging Snowflake ML and LLMOps capabilities.
- Evaluate and recommend enterprise data technology platforms, including data governance and data security solutions.
- Develop scalable data models and robust data pipelines while ensuring data quality, consistency, and integrity.
- Document solution architecture, data flows, and transformation logic to support maintainability and knowledge sharing.
- Implement best practices for data lifecycle management, data retention, cloud computing, and modern software development.
- Support data governance, metadata management, and data quality initiatives.
- Lead legacy policy and data conversion efforts to modern cloud-based platforms.
Required Qualifications- 12+ years of experience in Data Architecture and Data Engineering, with a proven track record of delivering large-scale data transformation programs.
- Extensive hands-on experience designing and implementing Snowflake solutions on AWS.
Strong expertise with:- AWS Glue (ETL/ELT)
- Snowflake OpenFlow
- Apache Airflow
- dbt
- Experience implementing Lakehouse architectures and Medallion Architecture.
- Proven experience optimizing Snowflake performance, scalability, and cost.
- Experience leading migrations from Cloudera to Snowflake.
- Strong experience with SQL, data modeling, ETL/ELT processes, and scripting using Python and/or Java.
Experience with enterprise data warehouse platforms such as:- Cloudera
- AWS Redshift
- Informatica IDMC
- Informatica PowerCenter
- Informatica BDM
Strong understanding of:- Data lifecycle management
- Data retention strategies
- Data modeling
- Cloud computing
- Modern software development practices
- Experience with data governance, metadata management, and data quality frameworks, including Collibra and Informatica.
- Experience with legacy policy and data migration to modern cloud platforms.
- Excellent documentation, communication, and collaboration skills.
Preferred Qualifications- Experience within the Insurance or Financial Services industry.
- Hands-on experience deploying dbt on AWS ECS.
- Experience designing Streamlit applications.
- Knowledge of Snowflake ML and LLMOps capabilities.
- Experience evaluating enterprise data governance and security platforms.
Certifications- SnowPro Advanced Certification (Preferred)