LTIMindtree

Senior Specialist - Data Engineering

LTIMindtree • $110K — $130K *
Charlotte, NC 28269In-Person
Information Technology
5 - 7 years of experience
Today
Be an Early Applicant
Job Overview by Ladders

Qualifications

  • 5+ years of experience with Hadoop ecosystem technologies on-premise
  • Expertise in PySpark for large-scale data processing
  • Solid understanding of HDFS architecture and storage mechanisms
  • Proficiency in Hive for data warehousing and querying
  • Experience building and optimizing Spark jobs
  • Familiarity with data ingestion using Sqoop
  • Strong problem-solving skills and ability to work independently

Responsibilities

  • Design, develop, and maintain scalable data pipelines
  • Build and optimize Spark jobs for performance
  • Query and manage data with Hive
  • Troubleshoot and resolve data pipeline and processing issues
  • Implement data quality governance and best practices
  • Work with large volumes of structured and unstructured data
  • Collaborate in fast-paced environments to meet project deadlines

Benefits

  • Exposure to cutting-edge big data technologies
  • Opportunities for professional development and training
  • Collaborative work environment that encourages innovation
  • Potential for growth within a rapidly expanding team
  • Flexibility in workplace arrangements
Full Job Description
Role description

We are seeking a skilled Data Engineer with strong handson expertise in Hadoop ecosystem technologies particularly in onpremise environments The ideal candidate will have deep experience working with PySpark HDFS and Hive and a solid understanding of largescale data processing and distributed systems

Strong handson experience in Hadoop ecosystem onpremise

Expertise in PySpark for largescale data processing

Minimum 5 years of experience in HDFS Hive and Spark

Deep understanding of HDFS architecture and storage mechanisms

Proficiency in Hive for data warehousing and querying

Experience in building and optimizing Spark jobs

Handson experience with data ingestion using Sqoop

Strong knowledge of distributed data processing and big data concepts

Ability to design develop and maintain scalable data pipelines

Experience working with large volumes of structured and unstructured data

Strong skills in performance tuning and query optimization HiveSpark

Ability to troubleshoot and resolve data pipeline and processing issues

Good understanding of data quality governance and best practices

Exposure to cloud platforms AWSAzureGCP good to have

Strong problemsolving skills and ability to work independently in fastpaced environments

About LTIMindtree

LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise to help drive superior competitive differentiation, customer experiences, and business outcomes in a converging world. Powered by nearly 90,000 talented and entrepreneurial professionals across 30+ countries, LTIMindtree — a Larsen & Toubro Group company — combines the industry-acclaimed strengths of erstwhile Larsen and Toubro Infotech and Mindtree in solving the most complex business challenges and delivering transformation at scale.
Learn more about LTIMindtree
Industry
Information Technology
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at LTIMindtree

More Information Technology Jobs

Find similar Senior Specialist - Data Engineering jobs:

NationwideCharlotte, NC