Senior Big Data Engineer

EPAM Systems   •  

Hartford, CT

Industry: Professional, Scientific & Technical Services


Not Specified years

Posted 64 days ago

This job is no longer available.

Senior Big Data Engineer


You are curious, persistent, logical and clever – a true techie at heart. You enjoy living by the code of your craft and developing elegant solutions for complex problems. If this sounds like you, this could be the perfect opportunity to join EPAM as a Senior Big Data Engineer. Scroll down to learn more about the position’s responsibilities and requirements.

EPAM, recently named the #1 small tech company in the US by Forbes, is looking bring on a Lead BigData Engineer to join our growing team in Hartford, CT. Our ideal candidate will possess skills that make them a subject matter expert in variousbig data technologies and data science. These roles will entailarchitectureanalysis, design, development, and other skills.

What You’ll Do

  • Development of proposals for implementation and design of scalable big dataarchitecture
  • Participation in customer’s workshops and presentation of the proposed solution
  • Develop scalable production ready data integration and processing solutions
  • Convert large volumes of structured and unstructured customer data
  • Design, implement, and deploy high-performance, custom applications at scale on Hadoop
  • Define and develop networkinfrastructure solutions to enable partners and clients to scale NoSQL and relational databasearchitecture for growing demands and traffic
  • Define common business and development processes, platform and tools usage for data acquisition, storage, transformation, and analysis
  • Develop roadmaps and implementation strategy around data science initiatives including recommendation engines, predictive modeling, and machine learning
  • Review and audit of existing solution, design and system architecture
  • Perform profiling, troubleshooting of existing solutions
  • Create technical documentation

What You Have

  • Experience with major big data technologies and frameworks including but not limited to Hadoop, Apache Spark, Spark Streaming, Spark SQL, Dataframes, Kafka, along with experience in Hive, Pig, Sqoop, HDFS, and NoSQL (Cassandra, MongoDB, or Hbase)
  • Strong knowledge of programming in Scala, Java and Python
  • Experience in client-driven large-scale implementation projects
  • Data Science and Analytics experience is a plus (Machine Learning, Recommendation Engines, Search Personalization)
  • Experience with major data integration technologies and frameworks including but not limited to Informatica Integration Hub
  • Experience building Data Lakes and processing Data streams
  • Strong experience in applications design, development and maintenance
  • Solid knowledge of design patterns and refactoring concepts
  • Practical expertise in performance tuning and optimization, bottleneck problems analysis
  • Solid technical expertise & troubleshooting skills
  • Possess expertise in Object-Oriented Analysis and Design

What We Offer

  • Medical, Dental and Vision Insurance (Subsidized)
  • Health Savings Account
  • Flexible Spending Accounts (Healthcare, Dependent Care, Commuter)
  • Short-Term and Long-Term Disability (Company Provided)
  • Life and AD&D Insurance (Company Provided)
  • Employee Assistance Program
  • Matched 401(k) Retirement Savings Plan
  • Paid Time Off
  • Legal Plan and Identity Theft Protection
  • Accident Insurance
  • Employee Discounts
  • Pet Insurance

Job #: 42370