5-8 years of experience in Java, especially Java 8 and OOP principles.
Hands-on experience with Apache Spark, including Spark Core, Spark SQL, and DataFrames.
Strong background in distributed data processing within large-scale enterprise environments.
Proficient in SQL and handling large datasets efficiently.
Familiarity with data tools like HDFS, Hive, and Kafka.
Experience in developing REST APIs and backend services.
Comfortable working in Linux/Unix environments.
Responsibilities
Design, develop, and maintain scalable Java applications and Spark data processing pipelines.
Optimize batch and streaming data solutions using Apache Spark.
Create backend services utilizing Core Java and relevant frameworks.
Handle large datasets, ensuring performance, fault tolerance, and scalability.
Integrate Spark jobs with HDFS, Hive, Kafka, and various databases.
Optimize Spark jobs for performance, memory usage, and compute efficiency.
Collaborate effectively with cross-functional teams, including Data Engineers, QA, DevOps, and Product Owners.
Benefits
Mandatory certification through Karat Assessment is required for validation of skills.
Opportunity to work in a challenging BFSI environment that enhances technical expertise.
Engagement in Agile ceremonies allows for a collaborative and iterative work culture.
Full Job Description
Role description
Job Title: Sr. JAVA Spark Developer
Work Location : Tampa FL
Job Description:
We are looking for a highly skilled Java Apache Spark Developer with 5-8 years of experience in building scalable high performance data processing and backend applications
The ideal candidate should have strong hands-on expertise in Java Apache Spark distributed data processing and experience working in large-scale enterprises or BFSI environments
Key Responsibilities
Design develop and maintain scalable Java based applications and Spark data processing pipelines
Build and optimize batch and streaming data solutions using Apache Spark
Develop backend services using Java Core Java Java 8 and related frameworks
Work with large datasets and ensure high performance fault tolerance and scalability
Integrate Spark jobs with HDFS Hive Kafka relational and NoSQL databases
Optimize Spark jobs for performance memory and compute efficiency
Collaborate with cross functional teams including Data Engineers QA DevOps and Product Owners
Follow coding standards, best practices and secure development guidelines
Support production issues and perform root cause analysis
Participate in code reviews design discussions and Agile ceremonies
Required Skills Qualifications
Technical Skills
5-8 years of strong experience in Java Core Java Java 8 OOP concepts