Senior Specialist - Data Engineering

LTIMindtree Limited

$110K — $130K *
Enterprise Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of experience in SQL data analysis, including complex queries and joins.
  • Proficient with Azure Synapse and PySpark for data processing.
  • Hands-on experience with building and maintaining ETL/ELT and big data pipelines.
  • Familiar with the MSBI stack and Azure services like Data Factory and Data Lake.
  • Experience in troubleshooting data-related issues and ensuring data quality.
  • Knowledge of CI/CD practices using Azure DevOps and version control with Git.

Responsibilities

  • Design and implement ETL/ELT pipelines for data integration.
  • Monitor data quality and validate data within pipelines.
  • Collaborate with stakeholders to understand and translate business requirements for technical solutions.
  • Document technical specifications and maintain project documentation in Azure DevOps.
  • Provide regular updates on project status and manage work items.

Benefits

  • Opportunities for professional development and training.
  • Flexible work hours and potential remote work options.
  • A collaborative team environment with a focus on innovative solutions.
  • Access to the latest technologies and tools in data engineering.
Full Job Description
Role description

Must-Have Skills
• Strong SQL skills, including complex queries, joins, data analysis, and experience with SQL Data Warehouse or Azure SQL.
• Experience with Azure Synapse and PySpark for data processing and transformation.
• Hands-on experience building, maintaining, and enhancing ETL/ELT and big data pipelines.
• Working knowledge of the MSBI stack on Azure.
• Working knowledge of Azure Data Factory and Azure Data Lake Storage.
• Experience with data validation, data quality checks, and pipeline monitoring.
• Strong troubleshooting and problem-solving skills, with the ability to resolve data and pipeline-related issues.
• Experience with Azure DevOps, Git version control, and CI/CD practices.
• Ability to perform requirement analysis and translate business needs into technical solutions.
• Strong analytical thinking, with the ability to derive insights and inferences from data.
• Good verbal and written communication skills, along with effective coordination abilities.
• Ability to work independently as an individual contributor while collaborating effectively with technical leads and stakeholders.
• Experience creating and maintaining technical specifications, wiki documentation, and implementation documents.
• Ability to provide regular status updates and maintain Azure DevOps work items.

Good-to-Have Skills
• Hands-on experience with Power BI and BI reporting or dashboard development.
• Knowledge of Cosmos DB, Cosmos scripting, and experience implementing pipelines using Cosmos DB.
• Experience with version control tools and practices, including Azure DevOps, Git, and CI/CD.
• Experience with Azure Analytics services.
• Experience working with marketing campaign data and campaign analytics.
• Knowledge of data platform product telemetry analytics.
• Understanding of big data architecture and data engineering best practices.
• Experience with advanced data visualization and dashboarding using Power BI.
• Experience with data pipeline optimization, performance tuning, and cost optimization.
• Strong presentation and whiteboarding skills, with the ability to communicate technical solutions to stakeholders.
• Software engineering mindset, with a focus on clean, scalable, reusable, and maintainable code.

Similar Jobs

More Jobs at LTIMindtree Limited

More Enterprise Technology Jobs

Find similar Senior Specialist - Data Engineering jobs: