Hadoop Developer

Incedo

$100K — $130K *
Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in IT/Computer Science; Master's preferred or equivalent experience
  • 8-10 years of industry experience in data analysis and architecture
  • Experience with Hadoop, MapReduce, Spark, and similar distributed computing systems
  • 5+ years as a data engineer/solution architect in large-scale systems
  • Proficient in programming with languages like Java, Python, Scala
  • Experience with SQL, NoSQL, and relational database design

Responsibilities

  • Analyze source system data and flows to optimize architecture designs
  • Build and maintain data pipelines for various data types and processing methods
  • Lead a technical team of developers and analysts
  • Deliver large-scale distributed software solutions using big data technologies
  • Implement data warehousing best practices and complex integration pipelines

Benefits

  • Flexible contract or full-time position
  • Opportunity to work in a dynamic, large-scale global business environment
  • Gain exposure to cutting-edge technologies in big data and analytics
  • Potential for collaboration with leading experts in data engineering
  • Opportunity for professional growth with access to new tools and methodologies
Full Job Description
Job Description

Position : Hadoop Consultant
Location : Raleigh, NC
Duration: Contract/Full Time

Job Description:
• Bachelors (IT/Computer Science Preferred); Master's Degree preferred (IT/Computer Science Preferred) or equivalent experience
• 8-10 years of industry experience in analysing source system data and data flows, working with structured and unstructured data, and delivering data and solution architecture designs.
• Experience with clustered/distributed computing systems, such as Hadoop/MapReduce, Spark/SparkR, Lucene/ElasticSearch, Storm, Cassandra, Graph Databases, Analytics Notebooks like Jupyter, Zeppelin etc
• Experience building data pipelines for structured/unstructured, real-time/batch, events/synchronous/asynchronous using MQ, Kafka, Steam processing.
• 5+ years of experience as a data engineer/solution architect designing and delivering large scale distributed software systems, preferably in large scale global business- preferably using open source tools and big data technologies such as Cassandra, Hadoop, Hive, Prestodb, Impala, HBase, Spark, Storm, Redis, Drill etc
• Strong hands-on experience of programming with Java, Python, Scala etc.
• Experience with SQL, NoSQL, relational database design, and methods for efficiently retrieving data for Time Series Analytics.
• Knowledge of Data Warehousing best practices; modelling techniques and processes and complex data integration pipelines
• Experience gathering and processing raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.)
• Excellent technical skills - able to effectively lead a technical team of business intelligence and big data developers as well as data analysts.

Optional Skills:
• Experience in Machine Learning, Deep Learning, Data Science
• Experience with Cloud architecture & service like AWS, Azure
• Experience with Graph, Sematic Web, RDF Technologies
• Experience with Text Analytics using SOLR or ElasticSearch

Qualifications

Additional Information

Similar Jobs

More Jobs at Incedo

  • Business System Analyst
    $80K — $110K *
    Austin, TX 78745 (Travis County)
    Technical Services
    In-Person
  • Java Tech Lead
    $110K — $140K *
    Austin, TX 78745 (Travis County)
    Information Technology
    In-Person
  • Hadoop Developer
    $90K — $130K *
    Wilson, NC 27893 (Wilson County)
    Information Technology
    In-Person
  • Hadoop Developer
    $100K — $130K *
    Raleigh, NC 27610 (Wake County)
    Enterprise Technology
    In-Person
  • Consultant
    $80K — $110K *
    Austin, TX 78745 (Travis County)
    Business Services
    In-Person

More Enterprise Technology Jobs

Find similar Hadoop Developer jobs: