Data Engineer

Delan Associates, Inc

$100K — $120K *
Education, Government & Non-Profit
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Minimum 3 years in data processes and infrastructure, preferably in government or political organizing
  • Proficient in data tools like SQL, Python, R, GIS, Tableau, and advanced Excel/Google Sheets
  • Experience with data engineering tools/frameworks such as dbt, Docker, and Git
  • Familiarity with platforms like NGP VAN and Salesforce
  • Skilled in managing secure enterprise networks and TLS/SSL configurations
  • Experience with large data sets and AWS tools for automation
  • Knowledge of probabilistic frameworks for entity resolution and deduplication

Responsibilities

  • Enhance operational reporting data processes and infrastructure
  • Analyze and visualize data using specified tools
  • Implement data engineering and transformation pipelines
  • Support data orchestration and automation efforts
  • Manage complex network environments in secure government ecosystems
  • Process and manipulate large datasets for practical applications
  • Conduct entity resolution and deduplication tasks

Benefits

  • Professional development opportunities
  • Supportive and mission-driven work culture
  • Impetus for public service and community engagement
  • Collaborative team environment
  • Exposure to high-impact projects in the public sector
Full Job Description
Required Skills

A minimum of 3 years of experience with the following skill sets:
• Working with to improve operational and reporting data processes and infrastructure, including 1+ years working in government, or in community, issue, labor, or political organizing
• Experience using one or more of the following data processing, analysis, and visualization tools in a professional setting: SQL (Postgres, MSSQL, DuckDB), Python, R, GIS, Tableau, Looker Data Studio, Excel/Google Sheets (advanced)
• Experience using one or more of the following tools/frameworks to implement and support data engineering, transformation, and orchestration/automation: dbt and dbt-duckdb, Dagster, DLT, Docker, Ducklake (S3 Postgres), git and GitHub, Sling
• Experience using 1+ of the following platforms: NGP VAN, Salesforce, Hustle, Mobilize and Reach
• Proficiency in working with complex enterprise network environments in highly secure government ecosystems, including differentiating between public and private networks, working within the confines of private networks, managing TLS/SSL and termination, configuring data egress/ingress through forward and reverse proxies.
• Experience processing, cleaning, manipulating, managing, and analyzing large datasets and building pipelines to automate these steps, preferably in an AWS environment with tools such as EC2, ECR, Farget, IAM, Lambda functions, Redshift, S3 buckets, and VPC and private subnetting
• Experience conducting entity resolution and record linkage (i.e., deduplication) using probabilistic frameworks like Splink.
• A demonstrated interest in public service and improving the lives of New Yorkers
• Eagerness to take initiative, ask questions, learn new skills, and solve problems in a fast-paced, mission-driven environment
• Strong written and oral communication skills in English

Similar Jobs

More Jobs at Delan Associates, Inc

More Education, Government & Non-Profit Jobs

Find similar Data Engineer jobs: