Role description

Job Summary

Seeking a Specialist with 5 to 7 years of experience in Scala and big data technologies within the Hadoop Spark and SparkSQL ecosystem

Job Description

Design develop and optimize scalable big data processing solutions using Scala and Apache Spark Collaborate with crossfunctional teams to build and maintain robust data pipelines Analyze large datasets to extract actionable insights supporting business objectives Develop highperformance applications in distributed computing environments Ensure code quality maintainability and adherence to Scala programming best practices Participate in architecture discussions to enhance data platform capabilities Continuously evaluate and integrate emerging big data technologies and tools Troubleshoot and resolve complex data processing issues to maintain system reliability Document technical designs and implementation details for effective knowledge sharing

Roles and Responsibilities

Lead the development and deployment of big data solutions leveraging Scala Apache Spark and SparkSQL Collaborate with data engineers architects and stakeholders to gather requirements and deliver effective solutions Optimize Spark jobs for performance and scalability in production environments Mentor junior team members and provide technical guidance on best practices Ensure compliance with data governance and security policies Conduct code reviews and contribute to continuous improvement of development processes Monitor system performance proactively and address bottlenecks or failures Participate in sprint planning estimation and agile ceremonies to deliver highquality software