Data Engineer

Compunnel

$110K — $130K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Senior-level experience in data engineering with proven problem-solving skills.
  • Extensive hands-on experience with Databricks.
  • Strong knowledge of AWS services, specifically S3 and Lambda.
  • Proficient in Python and PySpark programming languages.
  • Solid SQL skills for data querying and manipulation.
  • Experience in data transformation and platform modernization projects.
  • Willingness to complete technical assessments in a multi-step interview process.

Responsibilities

  • Design and implement robust data transformation solutions.
  • Develop scalable data engineering solutions leveraging Databricks and AWS.
  • Utilize AWS services, focusing on S3 and Lambda functionalities.
  • Create data processing workflows using Python and PySpark frameworks.
  • Tackle complex data engineering challenges and transformations.
  • Assist in migrating legacy systems to advanced cloud platforms.
  • Collaborate with cross-functional technical teams on data modernization initiatives.

Benefits

  • Remote work flexibility with required onsite interview process.
  • Opportunities for professional growth in data engineering.
  • Engage in modern technologies including cloud innovations.
  • Chance to impact data strategy on high-visibility projects.
Full Job Description
Job Summary

We are seeking a seasoned Senior Data Engineer with strong experience solving complex data engineering problems. The project focuses on data transformation and modernization, including migrating from legacy platforms to cloud-enabled modern platforms. Extensive Databricks experience is required, along with strong AWS experience, including S3 and Lambda. Strong Python and PySpark skills are also required. Snowflake experience is a major plus and would make a candidate stand out. The role can be performed remotely; however, an onsite interview is required. The interview process includes a first round via Teams followed by an onsite round, with a technical assessment covering Python, PySpark, and SQL.

Key Responsibilities
• Design and implement data transformation solutions as part of legacy platform modernization initiatives.
• Develop and support scalable data engineering solutions using Databricks and AWS.
• Work with AWS services, including S3 and Lambda.
• Develop data processing and transformation workflows using Python and PySpark.
• Solve complex data engineering and data transformation problems.
• Support migration from legacy platforms to modern, cloud-enabled platforms.
• Collaborate with technical teams to deliver data modernization solutions.

Required Qualifications
• Senior-level experience in data engineering with a strong track record of solving data engineering problems.
• Extensive hands-on experience with Databricks.
• Strong AWS experience, including S3 and Lambda.
• Strong proficiency in Python and PySpark.
• Strong SQL skills.
• Experience with data transformation and platform modernization.
• Ability to successfully complete technical assessments covering Python, PySpark, and SQL.
• Ability to participate in an onsite interview.

Preferred Qualifications
• Experience with Snowflake is a major plus.
• Experience migrating legacy data platforms to modern, cloud-enabled platforms.

Similar Jobs

More Jobs at Compunnel

More Information Technology Jobs

Find similar Data Engineer jobs: