Specialist - Data Engineering

LTM

$90K — $120K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5 to 7 years of experience in Scala development
  • Proficient in Hadoop and Spark frameworks
  • Experience with SparkSQL for data querying
  • Strong background in big data solution design
  • Ability to optimize data workflows and improve system performance

Responsibilities

  • Design and maintain scalable big data solutions
  • Implement complex data processing algorithms
  • Troubleshoot data ingestion and transformation issues
  • Participate in code reviews and provide peer feedback
  • Mentor junior team members in Scala and big data best practices
  • Collaborate with engineers and stakeholders to meet requirements
  • Monitor and enhance system performance for reliability

Benefits

  • Opportunity to work with cutting-edge big data technologies
  • Collaborative cross-functional team environment
  • Support for continuous learning and professional development
  • Mentorship opportunities
  • Challenging projects that enhance technical skills
Full Job Description
Role description

Job Title: Hadoop ,spark and scala Developer

Work Location : Mississauga-Ontario-CA

Job Summary

Seeking a Specialist with 5 to 7 years of experience in Scala to design and develop scalable big data solutions within the Hadoop and Spark ecosystem

Job Description
  • Develop robust and efficient data processing applications using Scala Work extensively with Hadoop and Spark frameworks to handle largescale data sets Utilize SparkSQL for querying and transforming data to meet business requirements Collaborate with crossfunctional teams to design and implement scalable data pipelines Optimize existing data workflows and improve system performance Ensure code quality by following best practices and conducting thorough testing Stay updated with emerging technologies in big data and Scala development

Roles and Responsibilities
  • Design develop and maintain scalable big data solutions leveraging Scala and Spark Implement complex data processing logic and algorithms to support analytics and reporting needs Troubleshoot and resolve issues related to data ingestion transformation and storage Participate in code reviews and provide constructive feedback to peers Mentor junior team members and share knowledge on Scala and big data technologies Collaborate with data engineers architects and stakeholders to understand requirements and deliver solutions Monitor system performance and implement enhancements to improve reliability and efficiency

Similar Jobs

More Jobs at LTM

More Information Technology Jobs

Find similar Specialist - Data Engineering jobs: