9+ years of experience in Big Data technologies (Hadoop, Hive, Pig, Storm, NoSQL, HBase, Cassandra, Druid) with a focus on Azure HDInsight.
5+ years of direct experience in Business Intelligence and Reporting.
5+ years hands-on experience with messaging systems like Kafka and data manipulation using Spark.
5+ years of cloud platform experience (AWS, Azure, Google) focusing on IaaS and PaaS solutions.
Familiarity with DevOps practices including Puppet, AWS Cloud Formation, Docker, and Microservices.
Experience in integrating data from diverse sources.
Proficiency in Machine Learning toolkits such as Mahout, SparkML, or H2O.
Responsibilities
Lead Big Data projects utilizing Hadoop and associated technologies.
Develop and optimize Business Intelligence reporting solutions.
Create and manage data manipulation pipelines using Spark.
Architect and implement solutions in cloud environments like Azure and AWS.
Collaborate on DevOps implementations and improve deployment processes.
Integrate various data sources to enhance data quality and accessibility.
Research and apply machine learning techniques for data analysis.
Benefits
Opportunities for professional growth and advancement.
Collaborative work environment emphasizing team success.
Access to cutting-edge technologies and tools.
Work with a passionate team focused on innovation.
Flexible work arrangements to promote work-life balance.
Full Job Description
Job Description
Description:
9+ years' experience working in Big Data (Hadoop, Hive, Pig, Storm, NoSQL, HBase, Cassandra, Druid) preferably in Azure HDInsight.
5+ years' hands-on experience working with Business Intelligence and Reporting
5+ years' hands-on Experience with various messaging systems, such as Kafka, Spark data manipulation, pipeline creation.
5+ years' hands-on experience working within AWS, Azure, Google, or other Cloud Platform based on IaaS and PaaS Solutions.
Hands-on experience with DevOps solutions like: Puppet, AWS Cloud Formation, Docker and Micro services.
Experience with integration of data from multiple data sources
Experience with Big Data ML (Machine Learning) toolkits, such as Mahout, SparkML, or H2O (supervised/unsupervised learning, classification and regression and so on)
Experience working with (hands-on) or working with teams who work within the Business Intelligence & Visualization Space (Tableau, Power BI, Qlik, Cognos, SAP BOBJ, etc.)
Passion for working with open-source technologies as well as commercial platforms