The
Palantir Data Engineer leverages advanced Python skills within a small team to develop and implement data transformation pipelines in Palantir's environment. They will be responsible for all workflows, configuration, and management of a Palantir-based application. The Data Engineer will also integrate with external systems via API, parse API responses into usable data objects, design user interfaces, and develop custom functions with TypeScript. Data Engineer will conduct code reviews, solution brainstorming, and define UI designs and functionalities. Successful candidate must be able to perform tier 2 level triage with customers and translate concerns into specific requirements. Ability to effectively triage requirements and articulate impacts on the existing environment is critical to mission success. Data Engineer will also develop new tools, code, and services to execute data engineering activities involving data of varying types and in varying conditions.
Responsibilities- Movement of structure and unstructured data using approved methods
- Execute data ingestion activities for storing data in a local or enterprise level location
- Develop code to format data that supports exploration
- Analyze source data formats and work with Data Scientists and partners to determine the formats and transforms that best meet mission objective
- Develop code and tools to provide one-time and on-going data extraction from various repositories, formatting and transformations into enterprise or standalone data models
- Develop new ETL and perform O&M and enhancements on existing ETL code using best practices/standards
- Develop and deliver documentation for each project including ETL mappings, code use guide, code location, and access instructions
- Define and implement complex data workflows for analytic systems
- Manage data retention policies, to include performing data deletion
- Manage USP data within the IC under Cl authorities
Requirements- TS/SCI FSP Clearance
- Minimum of 3-5 years' experience with:
- Python
- Palantir Foundry
- Palantir Pipeline Builder
- Palantir Workshop
- Typescript
- Proficiency with programming languages such as Java, C++, Python, JavaScript, or similar languages
- Understanding of XML, YAML, and JSON files and their roles within a system
- Familiarity with data structures, storage systems, cloud infrastructure, front-end frameworks, and other technical tools, as well as an understanding of how technical decisions impact the user of what you're building
