Nelnet

Data Engineer

Nelnet$100K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor’s degree in Computer Science, Information Systems, Engineering, Mathematics, or equivalent experience.
  • 5+ years experience building and operating production data pipelines with strong Python and SQL skills.
  • Solid knowledge of relational databases (SQL Server, Oracle, PostgreSQL).
  • Experience with data-quality checks at the ingestion boundary, including schema-drift detection and row-count validation.
  • Familiarity with data modeling concepts and change-data-capture (CDC) patterns.

Responsibilities

  • Build and maintain CDC and batch pipelines from source systems into the Snowflake Bronze layer using Redpanda, Python, and Dagster.
  • Design and maintain raw snapshot tables in the Bronze layer, ensuring minimal transformation for audit purposes.
  • Implement and monitor historical tracking to maintain data integrity in the Bronze layer.
  • Contribute to building conformed Silver models with business rules defined by the Analytics Engineer.
  • Run and monitor Dagster orchestration for pipeline reliability and observe SLA compliance.

Benefits

  • Medical, dental, and vision insurance.
  • Generous earned time off.
  • 401(k) with student loan repayment options.
  • Life insurance and AD&D insurance.
  • Tuition reimbursement and employee stock purchase program.
Full Job Description
The Data Engineer builds and maintains the ingestion pipelines, change-data-capture (CDC) streams, and Bronze-layer infrastructure that bring source-system data into Snowflake reliably, on time, and at the right grain. The Data Engineer ensures data is complete, ordered, and historically preserved — creating the raw material the Analytics Engineer models into governed data products.

This is more than an ingestion-only role, and it is built to grow. To start, the Data Engineer owns reliable ingestion and the Bronze layer, and works closely with the Analytics Engineer on the mechanics of getting data into conformed Silver models — including the reconciliation that proves the data ties out end to end. Over time, with Analytics Engineer partnership and Architect support, the Data Engineer develops deeper ownership of conforming work: turning messy, multi-system source data into models that mean the same thing across every source. This is an early hire on a small, capability-based data squad, with a clear growth path, working on the foundational data products of a new data platform.

Source-System Ingestion

•  Build and maintain CDC and batch pipelines from source systems into the Snowflake Bronze layer using Redpanda, Python, and Dagster.

•  Manage source-specific adapters across relational (SQL Server, Oracle), document (MongoDB), API, and file-based sources, and stand up new sources as the platform grows.

•  Handle the complexity of consolidating single-tenant source databases into a multi-tenant Snowflake model.

•  Implement idempotent load patterns with deduplication so pipelines can re-run safely without producing duplicate or missing records.

Bronze Layer Ownership

•  Design and maintain raw snapshot tables that preserve source-system state with minimal transformation — the immutable audit trail back to source.

•  Implement historical tracking so no data is silently overwritten.

•  Handle hard deletes from source systems by tracking deletions in Snowflake rather than losing them.

•  Maintain source-schema documentation and change detection — alert when upstream schemas drift unexpectedly.

Silver Build — Contribute and Grow (with the Analytics Engineer)

•  Build conformed Silver models from the business rules, grain, and conforming logic the Analytics Engineer defines — starting with close guidance and taking on more independence over time.

•  Own Bronze-to-Silver reconciliation: row counts and totals tie out, no records lost or double-counted across the transformation.

•  Help build and automate the mechanical contract gates — reconciliation tie-out, freshness, and schema validation — as CI/CD checks.

•  Apply classification tags at Bronze so columns can promote to Silver, partnering with the data owner and Data Governance on classification decisions.

•  Handle incremental logic and performance tuning as models grow in volume, with support as needed.

Pipeline Reliability and Observability

•  Run and monitor Dagster orchestration — scheduling, retries, failure alerting — and grow into fuller ownership of it, including SLA monitoring, over time.

•  Implement data-quality checks at the ingestion boundary (row counts, schema validation, freshness checks).

•  Monitor Snowflake concurrent-write limits and tune ingestion patterns to avoid bottlenecks.

•  Participate in severity-1 incident response — failed file loads, latency cascades, duplicate transactions, and similar.

Platform Collaboration

•  Work with Platform Engineering on Docker-based containerization and provisioning of Snowflake databases, schemas, and warehouses.

•  Apply required tags (domain, squad, product, layer, environment) to Snowflake objects, Dagster jobs, and streaming topics for cost attribution.

•  Participate in the HVR-to-Redpanda CDC migration and validate data integrity during cutover.

•  Contribute to shared CI/CD pipeline templates that standardize ingestion and build patterns.

Annual compensation for this role is $100,000 depending on experience.

This position offers a hybrid work option. Nelnet values flexibility and understands the importance of work-life integration. Our hybrid work environment allows associates living within 30 miles of an office location to work remotely for part of the week, while also fostering collaboration and team connection through in-office presence three days per week.

Please note that we are unable to provide visa sponsorship for this position. To be considered, candidates must already be authorized to work in the United States without the need for current or future sponsorship.

EDUCATION:

Bachelor’s degree in Computer Science, Information Systems, Engineering, Mathematics, or a related field; or an equivalent combination of education and directly related experience.

EXPERIENCE:

Required:

•  Experience building and operating production data pipelines with strong Python and SQL skills.

•  Solid working knowledge of relational databases (SQL Server, Oracle, or PostgreSQL).

•  Experience implementing data-quality checks at the ingestion boundary — schema-drift detection, row-count validation, freshness monitoring — and reconciling that data ties out end to end.

•  General familiarity with data modeling concepts.

Will develop in role (mentorship and support provided):

•  Conforming data across systems — reconciling differing keys, codes, and grains from multiple sources into a single consistent model.

•  Deeper ownership of orchestration (Dagster) — scheduling, retries, failure alerting, SLA monitoring.

•  The modern streaming / CDC stack — Redpanda for change-data-capture.

•  Governance-integrated engineering — classification tagging and the promotion gates that depend on it, in partnership with Data Governance.

•  dbt-based layered modeling (Bronze / Silver / Gold) at production maturity.

Preferred:

•  Any prior exposure to CDC / streaming platforms (Redpanda, Kafka, or similar).

•  Experience with a document / NoSQL platform (MongoDB preferred).

•  Experience with Snowflake (multi-tenant patterns, Snowpipe, tasks, streams).

•  Containerization and provisioning experience with Docker.

•  Experience consolidating single-tenant sources into a multi-tenant warehouse.

•  Exposure to data-governance practices — classification, masking, retention — in a regulated data environment.

•  Experience with financial, payment, or transaction data, including reconciliation and settlement concepts.

COMPETENCIES – SKILLS/KNOWLEDGE/ABILITIES:

•  Strong analytical and problem-solving skills, with the discipline to prove data is correct rather than assume it.

•  Comfort working closely with an Analytics Engineer — taking direction on modeling logic while owning the build and reliability of it.

•  A genuine interest in growing into conforming and Silver-layer modeling work; coachable and motivated by a defined growth path.

•  Clear written and verbal communication, including documenting pipelines and surfacing issues early rather than absorbing them silently.

•  Attention to detail with data quality, historical preservation, and auditability.

•  Ability to manage competing priorities and participate in incident response with composure.

•  Collaborative working style across engineering, platform, governance, and product roles.

Our benefits package includes medical, dental, vision, HSA and FSA, generous earned time off, 401K/student loan repayment, life insurance & AD&D insurance, employee assistance program, employee stock purchase program, tuition reimbursement, performance-based incentive pay, short- and long-term disability, and a robust wellness program. Click here to learn more about our benefits:

About Nelnet

Nelnet, Inc. provides educational services in loan servicing, payment processing, education planning, and asset management. The company is headquartered in Lincoln, Nebraska and has additional offices in Omaha, Nebraska; Aurora, Colorado; Tigard, Oregon; and Sacramento, California. Nelnet was founded in 1978 and is one of the largest student loan servicers in the United States. Nelnet also provides software and data management services for the education finance industry. The company has three primary business segments: Loan Systems and Servicing, Tuition Payment Processing, and Communications. Nelnet is publicly traded on the New York Stock Exchange under the ticker symbol NNI.
Learn more about Nelnet
Size
7,988 employees
Market Cap
$3.3 billion
Industry
Net Income
$352.4 million
Founded
1977
5 Year Trend
+3%
Revenue
$1.4 billion
NASDAQ

Similar Jobs

More Jobs at Nelnet

More Information Technology Jobs

Find similar Data Engineer jobs: