5-7 years of experience in the Big Data Hadoop Ecosystem
Proficiency with Hadoop components like HDFS, MapReduce, and YARN
Experience in developing scalable data pipelines and workflows
Knowledge of Apache Spark and SparkSQL for data processing
Strong Python programming skills for data manipulation
Ability to ensure data quality, reliability, and security
Responsibilities
Design and develop big data solutions using Hadoop components
Optimize and tune Hadoop and Spark jobs for better performance
Implement data ingestion, transformation, and aggregation processes
Troubleshoot data processing and storage issues
Collaborate with cross-functional teams to understand data needs
Develop and maintain documentation for data workflows and architecture
Mentor junior team members in big data technologies
Benefits
Opportunity to work in a dynamic tech environment
Collaborative team culture with cross-functional engagement
Potential for professional growth and mentorship
Involvement in cutting-edge big data technologies
Focus on continuous learning and keeping up with industry trends
Full Job Description
Role description
Job Title: Big data Developer
Work Location : Tampa,florda
Job Summary
Seeking a Specialist with 5 to 7 years of experience in the Big Data Hadoop Ecosystem to design develop and optimize largescale data solutions
Job Description
Work extensively with the Big Data Hadoop Ecosystem to manage and process large datasets Utilize Hadoop components such as HDFS MapReduce and YARN for efficient data storage and processing Develop scalable data pipelines and workflows to support data analytics and business intelligence initiatives Collaborate with crossfunctional teams to integrate data from diverse sources Leverage Apache Spark and SparkSQL to improve data processing speed and efficiency Apply Python programming skills for data manipulation automation and scripting tasks Ensure data quality reliability and security across all data processes Stay updated with the latest advancements and trends in Hadoop and big data technologies
Roles and Responsibilities
Design develop and maintain big data solutions using Hadoop Ecosystem components Optimize and tune Hadoop and Spark jobs to enhance performance and scalability Implement data ingestion transformation and aggregation processes Troubleshoot and resolve issues related to data processing and storage Collaborate with data scientists analysts and other stakeholders to gather and understand data requirements Develop and maintain comprehensive documentation for data workflows architecture and processes Mentor junior team members and provide technical guidance on big data technologies Participate in code reviews testing and deployment activities to ensure highquality deliverables
