7-15 years of strong experience in data engineering and analytics
Very strong expertise in Snowflake architecture and optimization
Proven experience in Hadoop migration projects
Proficient in programming languages: Python, Java, and SQL
Deep understanding of Big Data frameworks including HDFS, MapReduce, Hive, Spark, PySpark, and Snowspark
Knowledge of data ingestion, transformation, quality checks, and security practices
Ability to design efficient data models for data warehousing environments
Responsibilities
Design and implement Hadoop MapReduce jobs for complex data processing tasks
Utilize HiveQL for querying and manipulating large datasets within Hadoop
Leverage Spark for real-time data processing and streaming analytics
Design efficient data models in Snowflake to optimize query performance
Create Snowflake views and materialized views to enhance query efficiency
Implement data governance policies within Snowflake to ensure data quality and security
Write complex SQL queries on Snowflake to extract insights from large datasets
Benefits
Opportunity to work in a cutting-edge data environment
Engagement with advanced technologies like Snowflake and Hadoop
Potential for professional growth in data engineering
Collaborative team culture focused on innovation
Access to ongoing training and development opportunities
Full Job Description
Snowflake & Hadoop Lead
JOB SUMMARY Work Location - Alpharetta, GA.
Key Responsibilities • Design and implement Hadoop MapReduce jobs for complex data processing tasks. • Utilize HiveQL for querying and manipulating large datasets within Hadoop. • Leverage Spark for real-time data processing and streaming analytics when needed. • Design efficient data models in Snowflake to optimize query performance and data access. • Create Snowflake views and materialized views to enhance query efficiency for data analysis. • Implement data governance policies within Snowflake to ensure data quality and security. • Write complex SQL queries on Snowflake to extract insights from large datasets.
Required Qualifications • 7-15 years of strong experience • Very strong in Snowflake • Strong Hadoop migration experience • Programming Languages : Strong proficiency in Python, Java and SQL • Big Data Frameworks : Deep understanding of ecosystym (HDFS, MapReduce, Hive, Spark, PySpark, Snowspark) • Cloud Data Warehousing : Expertise in Snowflake architecture, data manipulation and query optimization • Data Engineering Concepts : Knowledge of data ingestion, transformation, data quality checks and data security practices. • Data modeling : Ability to design efficient data models for data warehousing environments.