Spark Developer-Module Lead

Keylent, Inc.

$100K — $130K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's Degree in a relevant field
  • Experience with Spark Tuning and Spark Jobs
  • Proficiency in Hive, SQL, and Impala
  • Skilled in writing Shell Scripts
  • Strong understanding of Hadoop architecture and performance tuning techniques

Responsibilities

  • Monitor and enhance performance of Hadoop clusters and components
  • Manage job performances and handle disk-space issues
  • Collaborate across teams for software deployment and capacity planning
  • Conduct troubleshooting and resolve user issues efficiently
  • Execute performance tuning strategies for Spark Jobs
  • Develop data solutions using Python and various big data tools

Benefits

  • Flexible working arrangements
  • Opportunities for professional growth and development
  • Exposure to cutting-edge big data technologies
  • Collaborative work environment with cross-functional teams
  • Involvement in impactful projects within the organization
Full Job Description
Visa status: U.S. Citizens and those authorized to work in the U.S. are encouraged to apply.
Tax Terms: W2, 1099
Corp-Corp or 3rd Parties: Yes

Education: Bachelor's Degree
Skills: Spark Tuning, Spark Jobs, Hive, SQL, Impala, Shell Scripts
  • Performance tuning of Hadoop clusters and various Hadoop components and routines
  • Monitor job performances, file system/disk-space management, cluster and database connectivity, log files, management of backup/archival/security and troubleshooting various user issues
  • Hadoop cluster performance monitoring and tuning, disk space management
  • Collaborate with various cross functional teams; infrastructure, network, and application for various activities: deployment of new software, environment, capacity
  • Performance tuning of Spark Jobs
  • Development using Python, Spark, Hive, SQL, Impala and shell scripts
Skills
APPS NICHE SKILLS - JAVA AND J2EE TECHNOLOGIES-SPARK

Similar Jobs

More Jobs at Keylent, Inc.

More Information Technology Jobs

Find similar Spark Developer-Module Lead jobs: