5-7 years of experience in data architecture and cloud migration
Expertise in migrating Hadoop ecosystems to Databricks and AWS
Proven experience with HBase, Hive, HDFS, and Spark
Strong understanding of cloud-native architectures and data model redesign
Hands-on experience with Spark migration and job refactoring
Familiarity with AWS services like S3, IAM, EC2, and Glue
Experience in data governance and compliance frameworks
Responsibilities
Lead large-scale migration of legacy Hadoop systems to Databricks
Develop end-to-end migration strategies and assess current platforms
Drive performance benchmarking and target architecture design
Optimize data models and schema conversions for cloud environments
Refactor Spark jobs and optimize cluster performance
Collaborate with cross-functional teams to ensure smooth transitions
Implement automation frameworks and manage production cutover planning
Benefits
Opportunity to work with cutting-edge cloud technologies
Collaborative work environment with cross-functional teams
Focus on professional development and skill enhancement
Engagement in large-scale modernization projects
Potential for career advancement in cloud architecture
Full Job Description
Role description
Job Title: Sr.DATABRICKS Architect
Work Location
Jersey City, NJ
Job Description:
Data Bricks JD
Databricks migration expert Hadoop to Databricks Migration Expert responsible for leading largescale modernization of legacy Hadoop ecosystems to AWS and Databricks cloud platforms
Must have proven experience migrating HBase Hive HDFS Spark and onprem ETL workloads to scalable cloud native architectures
Drives end-to-end migration strategy including assessment of current state platforms dependency mapping workload prioritization performance benchmarking and target state architecture design
Strong expertise in HBase to cloud migration including data model redesign performance optimization schema conversion and replacement strategies using Databricks Delta Lake cloud object storage or NoSQL alternatives where needed
Handson experience in Spark migration from onprem clusters to Databricks including job refactoring cluster optimization orchestration redesign and cost performance tuning
Works closely with infrastructure security application and business teams to ensure minimal disruption and strong governance during transition
Responsible for migration patterns automation frameworks reconciliation controls data validation and production cutover planning
Ensures platform reliability scalability and regulatory compliance while reducing operational cost and technical debt
Experience with AWS services such as S3 IAM EC2 Glue EMR Kafka integration and enterprise data governance is strongly preferred
