Azure Data Engineer

Prophecy Technologies

• $100K — $130K *
Chicago, IL 60629In-Person
Finance & Insurance
8 - 10 years of experience
Today
Be an Early Applicant
Job Overview by Ladders

Qualifications

  • 10+ years of experience as an Azure Data Engineer
  • Significant background in the banking domain
  • Proficient in Azure Databricks, ADLS, Synapse, and Azure Data Factory
  • Skilled in creating data pipelines and migrating databases to Azure
  • Strong command of SQL and Python
  • Experience with data formats such as CSV, Parquet, and JSON
  • Preferred experience in Snowflake data warehouse platform

Responsibilities

  • Design and implement Azure Databricks services to manage data processing
  • Create and manage data pipelines for migrating data from on-premises to Azure
  • Read and write data to/from Azure Blob storage and Azure Synapse Gen2
  • Utilize Databricks File System (DBFS) for data organization and retrieval
  • Work with Resilient Distributed Datasets (RDD) and DataFrames for data manipulation
  • Develop solutions for effective data analytics and reporting
  • Communicate technical concepts clearly to stakeholders

Benefits

  • Opportunities for continuous learning and professional development
  • Collaborative and inclusive workplace culture
  • Access to the latest tools and technologies
  • Flexible working environment with options for remote work
  • Potential for career advancement within the organization
Full Job Description
ROLE_DESCRIPTION - Role Descriptions: Azure Data engineer: Min. 10+ years of experience with good work experience in Banking domainStrong experience in Azure Databricks| ADLS| Synapse and Azure Data FactoryExperience in creating data pipelines and migrating data from on-prem database to Azure Cloud DBCreating Azure Databricks servicesReading & writing data from/to Azure Blob storage & Azure Synapse Gen2 storage using Azure Databricks services after receiving in different formats (e.g. csv| Parquet| Jason etc.) from Snowflake DWH platformHands-on experience in working with Databricks File system (DBFS)Experience in working with RDD| Dataframe| Azure SQL databaseExperience working in Snowflake would be preferredVery strong experience in SQL and PythonVery good analytical and problem-solving abilityVery good communication skills. Essential Skills: Azure Data engineer: Min. 10+ years of experience with good work experience in Banking domainStrong experience in Azure Databricks| ADLS| Synapse and Azure Data FactoryExperience in creating data pipelines and migrating data from on-prem database to Azure Cloud DBCreating Azure Databricks servicesReading & writing data from/to Azure Blob storage & Azure Synapse Gen2 storage using Azure Databricks services after receiving in different formats (e.g. csv| Parquet| Jason etc.) from Snowflake DWH platformHands-on experience in working with Databricks File system (DBFS)Experience in working with RDD| Dataframe| Azure SQL databaseExperience working in Snowflake would be preferredVery strong experience in SQL and PythonVery good analytical and problem-solving abilityVery good communication skills.
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at Prophecy Technologies

More Finance & Insurance Jobs

Find similar Azure Data Engineer jobs:

NationwideChicago, IL