Senior Data Analyst / Big Data Engineer

Cynet Systems   •  

Secaucus, NJ

Industry: Technology

  •  

Not Specified years

Posted 30 days ago

  by    Cynet Sytems

We are looking for Senior Data Analyst / Big Data Engineer for our client in Secaucus, NJ

Job Title: Senior Data Analyst / Big Data Engineer

Job Location: Secaucus, NJ

Job Type: Contract 12 Months

Job Description:

Mandatory Skills:

  • Experience with modern big data stack (Apache Spark, Hadoop, YARN, HDFS, Hive, Kafka)

Role and Responsibility:

  • Analyzes current state documentation and map findings to building and maintaining SharePoint domains for clinical teams
  • Assess needs for any information, data, Business Intelligence, analytical reporting, and Data Science and document the high-level requirements
  • Assist Project lead to map metric, business rules and definitions in systems landscape
  • Administrative and development procedures, tools and techniques
  • Identify the data, ingest, process, store, distribute then delivering data, enterprise solutions and services
  • Document operation models for governance involving dev/ops, agile, waterfall etc.
  • Assist in the planning and estimation process necessary for release and sprint planning
  • Map the information management lifecycle and strategy to the related in-scope business strategy
  • Current-state high-level data flow (based on identified business group and data)
  • Data map of subject areas aligned to business applications
  • Review and document application inventory - data management, Integration, sources, information delivery including C=conceptual, logical and physical data models

Experience and Qualifications:

  • Working with business analyst and visual designer to translate business needs into systems map
  • Plan, organize, and execute activities necessary to develop systems translating the business needs and objectives into the technical estimates and activities within agile sprints
  • Leading conversations and workshops with IT architecture necessary to identify challenges and solutions in delivering big data technologies
  • Effective communicator with good speaking and writing skills (UK English) and work as liaison between business users, data modelers, analytics practitioners and developers
  • Work with global delivery model and can communicate effectively across a diverse team
  • Bachelor's Degree
  • Experience with a modern big data stack including Apache Spark, Hadoop, YARN, HDFS, Hive, Kafka
  • Knowledge in Distributed Processing, Parallel Processing, Real-time Processing
  • Scripting / programming experience such as Scala / Java / Python / SQL / Linux
  • Experience cleansing and preparing large, complex datasets for analysis
  • Solid experience with Azure, RDBMS, SQL and expert in ETL development and troubleshooting
  • Maintain, modify and improve large sets of structured and unstructured data.
  • Requires linking and ingesting both proprietary data sets and customer data sets, so experience with ETL and data pipelines is required (both NoSQL and SQL-based data warehouses).
  • Using a micro-services based design and create high quality API's for data accessibility on the Hadoop platform, that ultimately integrate with a broader service based architecture