Logistics Management Institute

Data Engineer - Clearance Required

Logistics Management Institute$101K — $174K *
Aerospace & Defense
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor’s degree in Computer Science, Data Science, or related field, or equivalent work experience
  • 3-5 years of data engineering experience on the Palantir Foundry platform
  • Experience with data pipeline development using PySpark and Foundry applications
  • Working knowledge of Databricks for large-scale data processing
  • Proficiency in Python and SQL for pipeline development
  • Familiarity with data visualization tools and Git
  • Demonstrated leadership experience and active Secret Clearance or ability to obtain one

Responsibilities

  • Lead engineering efforts within Palantir Foundry for Army applications
  • Optimize Foundry pipelines with Python-based code and integration methods
  • Maintain data workflows in Databricks using notebooks and Delta Lake
  • Implement reusable code patterns using Python, SQL, and JavaScript
  • Translate analytics outputs into usable data products in Foundry
  • Integrate AI/ML tools into data applications and identify AI opportunities
  • Guide team practices towards AI-driven development and strategic client engagement

Benefits

  • Opportunity for technical leadership and innovation in AI applications
  • Engagement with Army stakeholders to influence strategic data solutions
  • Dynamic, fast-paced team environment with a focus on career growth
  • Evolving responsibilities with opportunities to expand development initiatives
  • On-site work preference in Pittsburgh, enhancing collaboration and impact
Full Job Description
Overview

LMI is seeking a skilled Data Engineer to join our team and contribute to developing innovative software programs that support activities for the Army’s AI2C organization, located in Pittsburgh, PA. This role is centered on building and operating data pipelines, ontologies, and applications within Palantir Foundry (Vantage), with secondary responsibilities extending into Databricks for large-scale data processing and analytics engineering. This position offers an opportunity to provide technical leadership while strategically growing the development footprint with the customer. Candidates should be comfortable working in a fast-paced, flexible environment and be self-directed, collaborative, and eager to grow technically. Candidates with the ability to be on-site in Pittsburgh are preferred.

Responsibilities
  • Lead data engineering efforts within Palantir Foundry (Vantage), including ontology design, pipeline development, and data integration for Army AI2C mission applications
  • Build, maintain, and optimize Foundry pipelines using Python-based transforms (PySpark/Pipeline Builder), Code Repositories, and Foundry’s data connection framework
  • Develop and maintain data engineering workflows in Databricks, including notebooks, Delta Lake tables, and Spark jobs, for workloads that complement or feed into the Foundry environment
  • Write, design, and implement efficient, reusable, and reliable code using Python, PySpark, SQL, and TypeScript/JavaScript as needed for Foundry Workshop or Slate applications
  • Translate complex data science and analytics outputs into governed, reusable data products surfaced through Foundry and Databricks
  • Lead the integration of AI/ML capabilities into Foundry and Databricks-based applications, identifying opportunities to leverage emerging AI technologies (including Foundry AIP or Databricks ML/AI tooling)
  • Champion AI-forward, platform-first development practices and guide the team in implementing AI/ML features and data-driven experiences
  • Provide technical leadership and mentorship to grow the team’s capabilities across Foundry (Vantage) and Databricks
  • Identify and pursue opportunities to expand development initiatives with Army stakeholders
  • Collaborate effectively with data scientists, UX designers, and software developers using Git, participating in code reviews and adopting Agile methodologies
  • Engage with Army managers and representatives in a consultative capacity to identify data platform needs, explore innovative data-driven solutions including AI applications, and build strategic relationships that expand our development footprint
  • Comfortable working independently and as a member of a team, with demonstrated ability to work in strategic and consultant-oriented environments
  • Excellent verbal and written communication skills with ability to articulate technical concepts to non-technical stakeholders and influence strategic decisions
Qualifications Minimum Qualifications
  • Bachelor’s degree in Computer Science, Data Science, Data Engineering, Software Engineering, Information Systems, or a related field, or equivalent work experience
  • 3-5 years of experience in data engineering, with hands-on experience building and operating applications on the Palantir Foundry (Vantage) platform
  • Demonstrated experience with Foundry pipeline development (PySpark/Pipeline Builder), Code Repositories, ontology/object modeling, and Foundry Workshop application building
  • Working experience with Databricks, including notebooks, Delta Lake, and Spark-based data processing, as a secondary platform to Foundry
  • Proficiency in Python and SQL for data manipulation and pipeline development (pandas, PySpark, numpy, or similar)
  • Familiarity with data visualization approaches (D3.js, Plotly, Recharts, or Foundry-native Workshop widgets) for surfacing pipeline outputs
  • Demonstrated experience in planning, analyzing, designing, implementing, testing, and maintaining data pipelines and applications for an enterprise-level system
  • Familiarity with Git, Agile methodologies, CI/CD, and automated deployments
  • Demonstrated experience in leadership roles, technical mentorship, or client relationship management
  • Active Secret Clearance or ability to obtain one is required
Additional Preferred Qualifications
  • Experience integrating AI/ML capabilities into Foundry or Databricks-based applications and identifying strategic AI use cases
  • Familiarity with AI frameworks and APIs (OpenAI, Anthropic Claude, LangChain, or similar) and with Foundry AIP
  • Knowledge of statistical analysis and machine learning concepts
  • Experience with Storybook for component development, documentation, and design system management
  • Hands-on deployment experience across multiple environments and platforms, including classified/air-gapped Foundry instances
  • Knowledge of the Army software development process and its technologies or experience developing applications for classified data
  • Background working in strategic planning or consultant environments supporting government or DoD clients
  • Proven track record of expanding technical scope or footprint with government customers
  • 7+ years of directly related experience
  • Master’s degree in Computer Science, Data Science, Data Engineering, Software Engineering, Information Systems, or related field
  • On-site (Pittsburgh) candidates preferred

 

The target salary range for this position is $101,144 - $174,591.

 

The salary range displayed represents the typical salary range for this position and is not a guarantee of compensation. Individual salaries are determined by various factors including, but not limited to location, internal equity, business considerations, client contract requirements, and candidate qualifications, such as education, experience, skills, and security clearances.   

 

Percentage of Travel Required: 10%

Job LocationsUS-PA-Pittsburgh US-Remote

About Logistics Management Institute

Logistics Management Institute (LMI) is a consulting firm dedicated to improving the management of government. LMI provides leaders with the objective analysis, tools, and programs they need to make informed decisions for their organizations. LMI is a not-for-profit organization that has been providing innovative solutions to complex problems since 1961. LMI serves clients in the federal government, state and local governments, and the private sector.
Learn more about Logistics Management Institute
Size
1,700 employees
Industry

Similar Jobs

More Jobs at Logistics Management Institute

More Aerospace & Defense Jobs

Find similar Data Engineer - Clearance Required jobs: