Principal - Data Engineering

LTM

$100K — $130K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience in data engineering with a focus on SQL, Python, and Spark.
  • Strong understanding of Hadoop ecosystem.
  • Experience with TypeScript for data processing applications.
  • Proficiency in designing scalable data pipelines within Palantir Foundry.
  • Familiarity with Palantir modules like Contour, Quiver, and Vertex.

Responsibilities

  • Design, develop, and optimize scalable data pipelines and workflows.
  • Collaborate with stakeholders to analyze and gather business requirements.
  • Translate business needs into effective data solutions using Palantir Foundry.
  • Maintain and enhance data models and operational dashboards for analytics.
  • Monitor and ensure data quality, integrity, and governance standards.
  • Utilize Palantir modules for application development and pipeline management.
  • Continuously update skills and knowledge on Palantir platform best practices.

Benefits

  • Opportunity to work with advanced data analytics tools and technologies.
  • Collaboration with cross-functional teams including offshore partners.
  • Exposure to new and evolving features of the Palantir platform.
  • Possibility for professional development in emerging data engineering trends.
Full Job Description
Role description

Seeking a skilled Data Engineer proficient in SQL Python Spark to design and optimize scalable data solutions within Palantir Foundry environment

Job Description Must have strong knowledge of SQL Python Spark and Hadoop Experience with Python Spark and TypeScript for data processing and application development Optimize performance of data transformations and analytical queries Collaborate with cross functional teams to understand business requirements and translate them into effective data solutions with offshore team Familiarity with designing and implementing scalable data pipelines and workflows using Palantir Foundry Working knowledge of Palantir modules such as Contour Quiver Vertex and app development Develop and maintain data models ontology layers and operational dashboards Ensure data quality integrity and governance across all Palantir based solutions Stay updated with Palantir platform updates and best practices Desired skills include Workshop level 4 Quiver level 4 AIP level 3 Pipeline Builder level 3 Code Repository level 3 PySpark level 3 and Ontology level 3 Roles and Responsibilities

Design develop and optimize scalable data pipelines and workflows Collaborate with stakeholders to gather and analyze business requirements Translate business needs into technical data solutions leveraging Palantir Foundry Maintain and enhance data models ontology layers and dashboards to support analytics Monitor and improve data quality integrity and governance standards Utilize modules like Contour Quiver and Vertex for application development Participate in code repository management and pipeline building activities Continuously update skills and knowledge on Palantir platform features and best practices

Similar Jobs

More Jobs at LTM

More Information Technology Jobs

Find similar Principal - Data Engineering jobs: