Data Engineer (114)

Delan Associates, Inc

$110K — $130K *
Education, Government & Non-Profit
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Minimum 3 years experience enhancing operational and reporting data processes in community, labor, or political environments.
  • Proficiency in data tools like SQL, Python, R, GIS, and Tableau; advanced Excel skills required.
  • Experience with data engineering frameworks such as dbt, Docker, and Dagster.
  • Familiarity with platforms like NGP VAN or Salesforce for data management.
  • Ability to navigate secure government network environments and manage data privacy protocols.
  • Strong skills in data cleaning, manipulation, and pipeline automation, preferably in AWS.
  • Proven background in entity resolution techniques, such as deduplication with Splink.

Responsibilities

  • Improve operational and reporting data processes for better performance.
  • Analyze and visualize data using advanced tools and methodologies.
  • Implement data engineering and automation practices to streamline workflows.
  • Manage and manipulate large datasets effectively and securely in AWS.
  • Conduct entity resolution to enhance data reliability and integrity.
  • Collaborate with stakeholders to ensure accurate data handling in sensitive environments.
  • Promote initiatives that improve public service delivery and community impact.

Benefits

  • Opportunities for professional development and continuous learning.
  • Engaging work environment focused on public service and community impact.
  • Flexible working arrangements to promote work-life balance.
  • Access to advanced data processing tools and technologies.
  • Collaboration with a diverse team committed to social change.
Full Job Description
Required Skills

A minimum of 3 years of experience with the following skill sets:
• Working with to improve operational and reporting data processes and infrastructure, including 1+ years working in government, or in community, issue, labor, or political organizing
• Experience using one or more of the following data processing, analysis, and visualization tools in a professional setting: SQL (Postgres, MSSQL, DuckDB), Python, R, GIS, Tableau, Looker Data Studio, Excel/Google Sheets (advanced)
• Experience using one or more of the following tools/frameworks to implement and support data engineering, transformation, and orchestration/automation: dbt and dbt-duckdb, Dagster, DLT, Docker, Ducklake (S3 Postgres), git and GitHub, Sling
• Experience using 1+ of the following platforms: NGP VAN, Salesforce, Hustle, Mobilize and Reach
• Proficiency in working with complex enterprise network environments in highly secure government ecosystems, including differentiating between public and private networks, working within the confines of private networks, managing TLS/SSL and termination, configuring data egress/ingress through forward and reverse proxies.
• Experience processing, cleaning, manipulating, managing, and analyzing large datasets and building pipelines to automate these steps, preferably in an AWS environment with tools such as EC2, ECR, Farget, IAM, Lambda functions, Redshift, S3 buckets, and VPC and private subnetting
• Experience conducting entity resolution and record linkage (i.e., deduplication) using probabilistic frameworks like Splink.
• A demonstrated interest in public service and improving the lives of New Yorkers
• Eagerness to take initiative, ask questions, learn new skills, and solve problems in a fast-paced, mission-driven environment
• Strong written and oral communication skills in English

Similar Jobs

More Jobs at Delan Associates, Inc

  • Data Engineer (114)
    $110K — $130K *
    New York, NY 10025 (New York County)
    Education, Government & Non-Profit
    In-Person
  • Data Engineer (114)
    $110K — $130K *
    Brooklyn, NY 11226 (Kings County)
    Education, Government & Non-Profit
    In-Person
  • Program Analyst_2 (36)
    $90K — $110K *
    Brooklyn, NY 11226 (Kings County)
    Information Technology
    In-Person
  • Program Analyst_2 (36)
    $95K — $115K *
    New York, NY 10025 (New York County)
    Information Technology
    In-Person
  • System Analyst_1 (39)
    $92K — $110K *
    Brooklyn, NY 11226 (Kings County)
    Information Technology
    In-Person

More Education, Government & Non-Profit Jobs

Find similar Data Engineer (114) jobs: