Databricks Data Engineer

Prophecy Technologies

$120K — $150K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 10 years of experience in software and data engineering
  • Strong background in Java and Python development
  • Expertise in Data Engineering for large-scale platforms
  • Deep familiarity with Databricks on AWS, including Spark and PySpark
  • Practical experience with AI/ML tools in production settings
  • Solid understanding of cloud-native architectures and governance
  • Proficient in Amazon Web Services (AWS) Cloud Computing

Responsibilities

  • Design and build large-scale data platforms using Databricks
  • Develop data processing frameworks using Spark and PySpark
  • Implement AI/ML tools and techniques within enterprise systems
  • Ensure data governance and security standards are met
  • Collaborate with cross-functional teams to optimize data flow
  • Maintain performance and scalability of data solutions

Benefits

  • Opportunity to work with cutting-edge data technologies
  • Engagement in innovative AI/ML projects
  • Collaboration with skilled and diverse teams
  • Career growth and development opportunities
  • Flexible work environment
Full Job Description
Role Overview:

This role is for an experienced Data Engineer with a strong background in software and data engineering, focusing on large-scale data platforms. The position requires deep expertise in Databricks on AWS, including Spark and PySpark, along with practical experience in applying AI/ML tools and techniques in production or enterprise platforms.

Required Skills:
  • 10 years of experience in software and data engineering
  • Strong hands-on background in Java and Python development
  • Deep experience in Data Engineering and large-scale platforms
  • Significant experience with Databricks on AWS, including Spark and PySpark
  • Practical experience applying AI/ML tools and techniques in production or enterprise platforms
  • Strong understanding of cloud-native architectures, security, and governance
  • Amazon Web Service (AWS) Cloud Computing
  • Advanced Java Concepts

Qualifications:
  • Minimum of 10 years of experience in software and data engineering.

Similar Jobs

More Jobs at Prophecy Technologies

More Information Technology Jobs

Find similar Databricks Data Engineer jobs: