8+ years of experience in data engineering and Azure technologies
Hands-on experience with the Databricks stack
Proficient in Python, SQL, and Scala programming
Expertise in data warehousing solutions and ETL tools (e.g., SSIS, Redwood)
In-depth understanding of streaming technologies and big data frameworks like Spark and Hadoop
Responsibilities
Integrate end-to-end data pipelines ensuring data quality and consistency
Design and implement data pipelines from various sources using Apache Spark and Azure Databricks
Build data pipelines using Azure Data Factory and Apache Spark
Develop solutions utilizing Azure services such as Azure Storage, Azure SQL Data Warehouse, and Azure Data Lake
Utilize ingestion tools like NiFi and Azure Cloud Factory for data processing
Benefits
Onsite working opportunity in Santa Clara, CA
Exposure to cutting-edge technologies in cloud computing and data engineering
Opportunity to work on large-scale data projects
Professional growth by working with experienced teams in the field
Hands-on involvement in critical solution designs and implementations
Full Job Description
Databricks Azure Engineer MAHIN-JOB-32334 Job Title:- Databricks Azure Engineer Experience: 8 + Years Job Location : Santa Clara, CA (Onsite) Job Description
Hands on experience in Databricks stack
Data Engineering technologies (Ex: Spark, Hadoop, Kafka etc.,)
Must me proficient in Streaming technologies
Hands on in Python, SQL
Expertise in implementing Data warehousing solutions
Expertise in Any ETL tool i.e. (SSIS, Redwood)
Good understanding on submitting jobs using Workflows, API & CLI
Designing and implementing highly performant data pipelines from multiple sources using Apache Spark and/or Azure Databricks
Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is always maintained
Highly proficient in using the spark framework (python and/or Scala)
Programming experience in Scala or Python, SQL
Direct experience of building data pipelines using Azure Data Factory and Apache Spark (preferably in Databricks).
Hands on experience designing and delivering solutions using Azure including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, Azure Cosmos DB, Azure Stream Analytics
Experience with ingestion tools (nifi/azure cloud factory
