Role description
Seeking a skilled Data Engineer proficient in SQL Python Spark to design and optimize scalable data solutions within Palantir Foundry environment
Job Description Must have strong knowledge of SQL Python Spark and Hadoop Experience with Python Spark and TypeScript for data processing and application development Optimize performance of data transformations and analytical queries Collaborate with cross functional teams to understand business requirements and translate them into effective data solutions with offshore team Familiarity with designing and implementing scalable data pipelines and workflows using Palantir Foundry Working knowledge of Palantir modules such as Contour Quiver Vertex and app development Develop and maintain data models ontology layers and operational dashboards Ensure data quality integrity and governance across all Palantir based solutions Stay updated with Palantir platform updates and best practices Desired skills include Workshop level 4 Quiver level 4 AIP level 3 Pipeline Builder level 3 Code Repository level 3 PySpark level 3 and Ontology level 3 Roles and Responsibilities
Design develop and optimize scalable data pipelines and workflows Collaborate with stakeholders to gather and analyze business requirements Translate business needs into technical data solutions leveraging Palantir Foundry Maintain and enhance data models ontology layers and dashboards to support analytics Monitor and improve data quality integrity and governance standards Utilize modules like Contour Quiver and Vertex for application development Participate in code repository management and pipeline building activities Continuously update skills and knowledge on Palantir platform features and best practices