Hadoop Developer

Centraprise

$120K — $150K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 9+ years of software development experience, with 4+ years in architecture and Big Data technologies.
  • Proficient in Hadoop ecosystem tools: HDFS, Hive, Spark.
  • Strong programming skills in Python and experience with PySpark for distributed data processing.
  • Hands-on experience with Apache Kafka for event-driven architectures.
  • Familiarity with Angular for frontend development, including TypeScript, HTML, and CSS.

Responsibilities

  • Define end-to-end architecture for data platforms and web applications.
  • Design and implement data pipelines for ingestion and processing with Hadoop and PySpark.
  • Optimize ETL workflows for large datasets and real-time streaming.
  • Build backend services using Python and microservices architecture.
  • Develop dynamic front-end applications using Angular and implement RESTful APIs.
  • Collaborate with product owners, business analysts, and DevOps teams.
  • Mentor junior developers and participate in agile ceremonies.

Benefits

  • Onsite work at multiple major cities: Charlotte, New York, Dallas, and Jersey City.
  • Opportunity to mentor junior developers and influence architectural decisions.
  • Hands-on work with emerging technologies in a robust tech stack.
  • Agile work environment fostering collaboration and innovation.
Full Job Description
Job Title :Hadoop Developer

Job Location : Charlotte, NC / New York, NY / Dallas, TX / Jersey City, NJ (ONSITE)

Job Type : Full-Time

Job Description:

Must Have Technical/Functional Skills

Primary Skill: Hadoop ecosystem (HDFS, Hive, Spark),PySpark,Python,Apache Kafka

Secondary: UI - Angular.

Experience: Minimum 9 years

Roles & Responsibilities

Architectural Leadership:
• Define end-to-end architecture for data platforms, streaming systems, and web applications.
• Ensure alignment with enterprise standards, security, and compliance requirements.
• Evaluate emerging technologies and recommend adoption strategies.

Data Engineering :
• Design and implement data ingestion, transformation, and processing pipelines using Hadoop, PySpark, and related tools.
• Optimize ETL workflows for large-scale datasets and real-time streaming.
• Integrate Apache Kafka for event-driven architectures and messaging.

Application Development :
• Build and maintain backend services using Python and microservices architecture.
• Develop responsive, dynamic front-end applications using Angular.
• Implement RESTful APIs and ensure seamless integration between components.

Collaboration & Leadership:
• Work closely with product owners, business analysts, and DevOps teams.
• Mentor junior developers and data engineers.
• Participate in agile ceremonies, code reviews, and design discussions.

Required Skills & Qualifications:

Technical Expertise:
• Strong experience with Hadoop ecosystem (HDFS, Hive, Spark).
• Proficiency in PySpark for distributed data processing.
• Advanced programming skills in Python.
• Hands-on experience with Apache Kafka for real-time streaming.
• Frontend development using Angular (TypeScript, HTML, CSS).

Architectural Skills:
• Expertise in designing scalable, secure, and high-performance systems.
• Familiarity with microservices, API design, and cloud-native architectures.

Additional Skills:
• Knowledge of CI/CD pipelines, containerization (Docker/Kubernetes).
• Exposure to cloud platforms (AWS, Azure, GCP).

Education:
• Bachelor's or Master's degree in Computer Science, Engineering, or related field.

Experience:
• 9+ years in software development, with at least 4 + years in architecture and Big Data technologies.

Preferred Qualifications:
• BFSI domain experience or large-scale enterprise systems.
• Understanding of data governance, security, and compliance standards.

Soft Skills:
• Strong analytical and problem-solving abilities.
• Excellent communication and leadership skills.
• Ability to thrive in a fast-paced, agile environment.

Similar Jobs

More Jobs at Centraprise

More Information Technology Jobs

Find similar Hadoop Developer jobs: