Big Data Hadoop Developer

Purple Drive Technologies

$90K — $130K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • In-depth knowledge of the Hadoop ecosystem including HDFS, MapReduce, Spark, Scala, and Hive.
  • Expertise in Hive for data warehousing and processing large datasets.
  • Strong experience with Apache Spark for distributed data processing and analytics.
  • Advanced proficiency in Scala programming for big data applications.
  • Familiarity with data modeling, ETL processes, and data integration techniques.
  • Experience with cloud platforms and big data tools like Google Big Query.
  • Strong analytical and problem-solving skills, along with solid SQL skills.

Responsibilities

  • Architect and design scalable big data solutions with Hadoop, Hive, Spark, and Scala.
  • Develop and optimize data pipelines and workflows for large-scale dataset analysis.
  • Manage and fine-tune distributed computing frameworks for high performance and reliability.
  • Collaborate with cross-functional teams to gather and define data requirements.
  • Implement data security, governance, and compliance measures in big data environments.
  • Diagnose and resolve technical issues in big data systems to maintain efficiency.

Benefits

  • Health, dental, and vision insurance.
  • 401(k) plan with company match.
  • Generous paid time off policy.
  • Professional development and training opportunities.
Full Job Description
Hi All,

Role Descriptions: Must Have TechnicalFunctional SkillsIn-depth knowledge of the Hadoop ecosystem| including HDFS| MapReduce| Spark | Scala | HiveExpertise in Hive for data warehousing and querying large datasets.Strong experience with Apache Spark for distributed data processing and real-time analytics.Advanced proficiency in Scala programming for big data application development.Familiarity with data modeling| ETL processes| and data integration techniques.Experience with cloud platforms and big data tools (e.g.| Google Big Query).Strong analytical and problem-solving skills to address complex data challenges.Basic knowledge on JAVA | SpringbootStrong SQL skill.Roles ResponsibilitiesArchitect and design scalable big data solutions leveraging technologies like Hadoop| Hive| Spark| and Scala.Develop and optimize data pipelines and workflows for processing and analyzing large-scale datasets.Manage and fine-tune distributed computing frameworks to ensure high performance and reliability.Collaborate with cross-functional teams| including data engineers| analysts| and business stakeholders| to gather and define data requirements.Implement data security| governance| and compliance measures in big data environments.Diagnose and resolve technical issues in big data systems to maintain operational efficiency.Generic Managerial Skills| If anyDecision Making| Problem Solving| Leadership| Time Managementproficient in Java Application development| Java script and Application developemnt

Essential Skills: Must Have TechnicalFunctional SkillsIn-depth knowledge of the Hadoop ecosystem| including HDFS| MapReduce| Spark | Scala | HiveExpertise in Hive for data warehousing and querying large datasets.Strong experience with Apache Spark for distributed data processing and real-time analytics.Advanced proficiency in Scala programming for big data application development.Familiarity with data modeling| ETL processes| and data integration techniques.Experience with cloud platforms and big data tools (e.g.| Google Big Query).Strong analytical and problem-solving skills to address complex data challenges.Basic knowledge on JAVA | SpringbootStrong SQL skill.Roles ResponsibilitiesArchitect and design scalable big data solutions leveraging technologies like Hadoop| Hive| Spark| and Scala.Develop and optimize data pipelines and workflows for processing and analyzing large-scale datasets.Manage and fine-tune distributed computing frameworks to ensure high performance and reliability.Collaborate with cross-functional teams| including data engineers| analysts| and business stakeholders| to gather and define data requirements.Implement data security| governance| and compliance measures in big data environments.Diagnose and resolve technical issues in big data systems to maintain operational efficiency.Generic Managerial Skills| If anyDecision Making| Problem Solving| Leadership| Time Managementproficient in Java Application development| Java script and Application developemnt

Similar Jobs

More Jobs at Purple Drive Technologies

  • Data Modeler
    $100K — $130K *
    Los Angeles, CA 90011 (Los Angeles County)
    Finance & Insurance
    In-Person
  • ServiceNow Architect
    $120K — $150K *
    Malvern, PA 19355 (Chester County)
    Enterprise Technology
    In-Person
  • Guidewire Lead Developer
    $100K — $130K *
    Plano, TX 75025 (Collin County)
    Finance & Insurance
    In-Person
  • Procurement Engineer
    $70K — $95K *
    Loveland, CO 80538 (Larimer County)
    Manufacturing & Automotive
    In-Person
  • Data Modeler
    $100K — $130K *
    Los Angeles, CA 90011 (Los Angeles County)
    Finance & Insurance
    In-Person

More Information Technology Jobs

Find similar Big Data Hadoop Developer jobs: