Specialist - Data Engineering

LTM

$90K — $120K *
Tampa, FL 33647In-Person
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of experience in Apache Spark and Java
  • Proficient in developing big data solutions in Databricks
  • Experience with SparkSQL and processing large datasets
  • Strong debugging skills for performance optimization
  • Understanding of data architecture principles and emerging technologies

Responsibilities

  • Develop code components using Apache Spark and Java
  • Implement and optimize Spark jobs in Databricks
  • Collaborate with stakeholders to assess data requirements
  • Conduct code reviews and mentor junior developers
  • Monitor data pipeline reliability and scalability
  • Document designs and best practices for data workflows
  • Work with DevOps to automate deployment processes

Benefits

  • Work in a collaborative, cross-functional team environment
  • Opportunities for personal and professional development
  • Engagement in innovative projects using cutting-edge technology
  • Contributions to enhancing data architecture and engineering practices
Full Job Description
Role description

Job Title: Data BricksDeveloper

Work Location : Tampa,Florida

Job Summary
  • Seeking a Specialist with 5 to 7 years of experience in Apache Spark and Java to develop and optimize big data solutions within the Databricks environment
  • Design develop and maintain scalable big data applications using Apache Spark and Java Collaborate with crossfunctional teams to implement data processing pipelines on Databricks Utilize SparkSQL and related technologies to transform and analyze large datasets efficiently Ensure code quality and performance optimization in Sparkbased applications Participate in data architecture design and contribute to the enhancement of data platforms Stay updated with emerging trends and technologies in the DatabricksSparkSQLScalaPythonJava ecosystem Support data engineering tasks including data ingestion data cleansing and data transformation Assist in troubleshooting and resolving performance bottlenecks in data workflows

Roles and Responsibilities
  • Develop robust and reusable code components using Apache Spark and Java Implement and optimize Spark jobs in the Databricks environment to meet business requirements Collaborate with data scientists analysts and other stakeholders to understand data needs Conduct code reviews and provide mentorship to junior team members Monitor and improve data pipeline reliability and scalability Document technical designs workflows and best practices Work closely with DevOps teams to automate deployment and monitoring processes Participate in sprint planning estimation and delivery of data engineering projects Leverage Databricks platform features to enhance data processing efficiency and security

Similar Jobs

More Jobs at LTM

More Information Technology Jobs

Find similar Specialist - Data Engineering jobs: