Senior Big Data Engineer

Salary depends on experience
Posted on 06/22/18
Hartford, CT
Professional, Scientific & Technical Services
Salary depends on experience
Posted on 06/22/18

DESCRIPTION

You are curious, persistent, logical and clever – a true techie at heart. You enjoy living by the code of your craft and developing elegant solutions for complex problems. If this sounds like you, this could be the perfect opportunity to join EPAM as a Senior Big Data Engineer. Scroll down to learn more about the position’s responsibilities and requirements.

EPAM, recently named the #1 small tech company in the US by Forbes, is looking bring on a Lead BigData Engineer to join our growing team in Hartford, CT. Our ideal candidate will possess skills that make them a subject matter expert in variousbig data technologies and data science. These roles will entailarchitectureanalysis, design, development, and other skills.

Responsibilities

  • Development of proposals for implementation and design of scalable big dataarchitecture
  • Participation in customer’s workshops and presentation of the proposed solution
  • Develop scalable production ready data integration and processing solutions
  • Convert large volumes of structured and unstructured customer data
  • Design, implement, and deploy high-performance, custom applications at scale on Hadoop
  • Define and develop networkinfrastructure solutions to enable partners and clients to scale NoSQL and relational databasearchitecture for growing demands and traffic
  • Define common business and development processes, platform and tools usage for data acquisition, storage, transformation, and analysis
  • Develop roadmaps and implementation strategy around data science initiatives including recommendation engines, predictive modeling, and machine learning
  • Review and audit of existing solution, design and system architecture
  • Perform profiling, troubleshooting of existing solutions
  • Create technical documentation

Qualification

  • Experience with major big data technologies and frameworks including but not limited to Hadoop, Apache Spark, Spark Streaming, Spark SQL, Dataframes, Kafka, along with experience in Hive, Pig, Sqoop, HDFS, and NoSQL (Cassandra, MongoDB, or Hbase)
  • Strong knowledge of programming in Scala, Java and Python
  • Experience in client-driven large-scale implementation projects
  • Data Science and Analytics experience is a plus (Machine Learning, Recommendation Engines, Search Personalization)
  • Experience with major data integration technologies and frameworks including but not limited to Informatica Integration Hub
  • Experience building Data Lakes and processing Data streams
  • Strong experience in applications design, development and maintenance
  • Solid knowledge of design patterns and refactoring concepts
  • Practical expertise in performance tuning and optimization, bottleneck problems analysis
  • Solid technical expertise & troubleshooting skills
  • Possess expertise in Object-Oriented Analysis and Design
Not the right job?
Join Ladders to find it.
With a free Ladders account, you can find the best jobs for you and be found by over 20,0000 recruiters.