Senior Specialist - Data Engineering

LTM

$100K — $130K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 8-10 years of software development experience, focusing on Azure Databricks and ETL processes.
  • 5+ years of ETL development experience, specifically with Azure Databricks.
  • Strong proficiency in pyspark and Python programming.
  • Experience with SQL, MS SQL Server, and relational databases.
  • Familiarity with Agile methodologies and tools such as JIRA.
  • Knowledge of insurance domain is beneficial.
  • Proven ability to communicate effectively with clients and manage offshore teams.

Responsibilities

  • Develop and maintain ETL pipelines using Azure Databricks.
  • Conduct design and code reviews to ensure quality and adherence to best practices.
  • Collaborate with stakeholders to gather and analyze project requirements.
  • Implement on-premises to cloud migration projects for Azure Databricks.
  • Provide technical solutions based on user requirements.
  • Review work effort estimations and manage project timelines.
  • Integrate various data sources, including CSV, XML, JSON, and relational databases.

Benefits

  • Opportunity to work onsite, enhancing collaboration with team members.
  • Engagement with diverse projects in the insurance domain.
  • Potential for professional growth in a leading technology environment.
Full Job Description
Role description

Role Senior Developer Azure Databricks

Experience 8-10 Years

Location - Branchville NJ

Technical Skills Primary

Primary Technologies Azure Databricks pyspark python

Database Technologies SQL MS SQL Server Relational Databases

Adherence to Application Development Documentation Best Practices

Experience in conducting Design Code Reviews

Strong experience on ETL concepts

Strong Hands on coding experience on primary technology

Technical Skills Secondary Nice to have NOT MANDATORY

Understanding on ADF platform and framework

Experience on working with XML JSON file

Experience on Informatica PC

Familiar with Agile software development methodologies preferable JIRA

Soft Skills

As this is an onsite role must have strong written and oral communication skills

Insurance Domain Knowledge

Strong ability to work with client stakeholders

Requirement Review and Work Effort Estimation

Ability to manage offshore team work and code review

Ability to understand user customer requirement and provide technical solution

Evaluation Questions

Does the candidate have minimum 5 yrs of experience working on ETL developemnt minimum 3 yrs experience on Azure Databricks development

has the candidate worked on onprem to cloud migration project for Azure Databricks for atleast 1 project

Does the candidate have advance level knowledge on ETL concepts to develop ETL pipeline from multiple types of date sources like csv xml JSON relational database

Similar Jobs

More Jobs at LTM

More Information Technology Jobs

Find similar Senior Specialist - Data Engineering jobs: