Req ID: 381611
Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Databricks.
Required Skills:
• Extensive hands-on experience with Databricks and Apache Spark (PySpark, Scala, or SQL) - 8+ years of experience
• Proficiency in at least one programming language (Python, Scala, or Java) - 5+ years of experience
• Strong understanding of cloud data architectures (Azure Data Lake, AWS S3, GCP Storage) and related ecosystem - 5+ years of experience
• Experience with CI/CD tools and DevOps practices for data engineering - 5+ years of experience
• Familiarity with data warehousing concepts and tools (Delta Lake, SQL, etc.) - 5+ years of experience
• Solid grasp of distributed computing, performance tuning, and big data best practices - 5+ years of experience
• Excellent communication and problem-solving skills - 5+ years of experience
Where required by law, NTT DATA provides a reasonable range of compensation for specific roles. The starting hourly range for this remote role is ($50.00 - $55.00 Hour). This range reflects the minimum and maximum target compensation for the position across all US locations. Actual compensation will depend on several factors, including the candidate's actual work location, relevant experience, technical skills, and other qualifications. This position may also be eligible for incentive compensation based on individual and/or company performance.
#LI-NorthAmerica
