Senior Data Engineer - ITS4

Minnesota Careers

$78K — $129K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 4+ years of IT business analysis experience
  • High-level technical knowledge of Databricks, Delta Lake, and Spark
  • Ability to maintain production data lakehouse environments
  • Experience designing ETL/ELT pipelines using Python and SQL
  • Demonstrated technical leadership collaborating with cross-functional teams

Responsibilities

  • Administer Databricks workspaces and provide operational support
  • Develop and enhance Databricks notebooks, jobs, and pipelines
  • Support MLOps engineering for AWS services like SageMaker and Glue
  • Manage the enterprise data lake for DEED programs
  • Evaluate and recommend new data engineering technologies

Benefits

  • Full state fringe benefits included for temporary positions
  • Training and professional development opportunities
  • Possible eligibility for the Federal Public Service Loan Forgiveness Program
  • Confidential Employee Assistance Program for personal well-being
  • Support for work/life challenges, including mental health and legal issues
Full Job Description
Job Details

Working Title: Senior Data Engineer
Job Class: Information Technology Specialist 4
Agency: Minnesota IT Services
  • Job ID: 95398
  • Location: St. Paul
  • Telework Eligible: Yes #LI-Hybrid
  • Full/Part Time: Full-Time
  • Regular/Temporary: Limited
  • Who May Apply: Open to all qualified job seekers
  • Date Posted: 07/21/2026
  • Closing Date: 07/29/2026
  • Hiring Agency/Seniority Unit: Minnesota IT Services
  • Division/Unit: Department of Employment & Economic Development
  • Work Shift/Work Hours: Day Shift
  • Days of Work: Monday - Friday
  • Travel Required: No
  • Salary Range: $37.72 - $62.21 / hourly; $78,759 - $129,894 / annually
  • Job Class Option: Data Systems
  • Classified Status: Unclassified
  • Bargaining Unit/Union: 214 - MN Assoc of Professional Empl/MAPE
  • End Date: Reference "Job Summary"
  • FLSA Status: Exempt - Professional
  • Designated in Connect 700 Program for Applicants with Disabilities : No

Job Summary

This position is temporary and includes full state fringe benefits; it is anticipated to last up to two (2) years.

This position exists to design, build, maintain, and support the Minnesota Department of Employment and Economic Development (DEED) data engineering and MLOps infrastructure. The role focuses on enabling scalable analytics and AI/ML workloads across Databricks and AWS services such as SageMaker, Bedrock, and Glue.

The ideal candidate will have hands-on experience delivering production-grade data pipelines and machine learning operations, and will ensure that DEED's Databricks workspace, data lake environments, and cloud-based AI services operate securely, efficiently, and reliably.

Key responsibilities include administering Databricks workspaces, developing and maintaining notebooks and production pipelines, and serving as a technical advisor to application and data science teams implementing MLOps patterns. The position also supports the ongoing administration of the enterprise data lake, contributes to data engineering best practices, and drives continuous improvement through evaluation and adoption of modern data and AI technologies.

This role requires applying project management and problem-solving skills to resolve technical issues, lead improvements, and ensure 24/7 availability and performance of production data engineering and MLOps services. Occasional work outside normal business hours may be required.

Primary Duties:
  • Databricks administration and operational support.
  • Development and enhancement of Databricks notebooks, jobs, and pipelines.
  • MLOpsengineering support for teams using SageMaker, Bedrock, Glue, and other AWS services.
  • Data lake management and data engineering for DEED programs.
  • Evaluation and recommendation of new data engineering and AI technologies.

This position requires an employee to work onsite at 600 Robert Street N, St. Paul, Minnesota. at least 50% [or more or less if space limitations remain] of the time, with limited telework available. Telework eligibility depends on residence:
  • Candidates living in Minnesota or within 50 miles of the worksite in a bordering state (IA, ND, SD, WI) may telework up to 50%.
  • Minnesota residents living more than 50 miles from the worksite may be eligible to telework more than 50%.
  • Candidates living 50 miles or more from the worksite in a bordering state are not eligible for hire unless relocating within 50 miles.


Qualifications

Minimum Qualifications

To qualify, candidates must clearly show all of the following qualifications in their resume. Resume tips available here :

This position requires a minimum of four (4) years of experience in performing IT business analysis functions.

Experience must include:
  • High-level technical knowledge of Databricks, Delta Lake, Spark, Unity Catalog, and datalakehousearchitecture.
  • Demonstrated ability to administer, develop,optimize, andmaintainproduction data lakehouse environments.
  • Designing,maintaining, and troubleshooting complex data pipelines and workflows.
  • Demonstrated ability to design scalable ETL/ELT pipelines using Python, SQL, Delta Live Tables, and Medallion architecture.
  • Demonstrated abilitytoprovidetechnicalleadershipandcollaboratewithcross-functionalteams,includingdevelopers,businessanalysts,data analysts, and business stakeholders to support enterprise applications and services.
  • Demonstratedability to communicateclearly and effectivelyin a mannerthatfacilitatesmutualunderstanding.
  • Customer-focusedapproachgroundedinactivelistening,empathy,andsolution-orientedproblem-solvingtodeliverpositiveuserexperiences.

Education in Information Technology (IT) or an IT related field may substitute for experience as follows: a master's degree for eighteen (18) months of experience; a bachelor's degree for one (1) year; and an associate's degree for six (6) months.

Strongly Preferred Qualifications
  • ExperiencewithCI/CDpipelinesandDevOpspractices,includingGitHubActionsorsimilarautomationplatformsfor infrastructure and application deployments.
  • Ability to implement andmaintaininfrastructure-as-code using Terraform, GitHub Actions, YAML.
  • Familiarity with AWS services related to data engineering (S3, RDS/Postgres, IAM, Glue, networking).
  • Experiencedesigning,implementing,andsupportingenterprisedatalakearchitecturesforanalytics,reporting,ordatascienceinitiatives.

Preferred Qualifications
  • Experienceimplementingdatabasesecuritybestpractices,includingencryption,accesscontrols,auditing,vulnerability remediation, and compliance with organizational security standards.
  • Experiencemonitoringandoptimizinghigh-availability(24x7)databaseenvironments,includingperformanceanalysis,capacity planning, replication, disaster recovery, and operational support

Additional Requirements

It is the policy of Minnesota IT Services that a successful candidate must pass all legally required checks prior to employment which may consist of the following:
  • SEMA4 Records Check (applies to current and past state employees only)
  • Criminal History Check
  • Reference Check
  • Social Security and Address Verification
  • Education Verification
  • CJIS Background Check
  • Other legally required checks

Minnesota IT Services does not participate in the federal E-Verify program. Minnesota IT Services is unable to sponsor applicants for work visas, including F-1 STEM OPT extensions, and cannot complete Form I-9 or any other documentation requiring employer participation in E-Verify. All applicants must be legally authorized to work in the United States at the time of application.

Application Details

How to Apply

Select "Apply for Job" at the top of this page. If you have questions about applying for jobs, contact the job information line at 651-259-3637 or email [email protected] . For additional information about the application process, go to http://www.mn.gov/careers .

Contact

If you have questions about this position, contact Human Resources at [email protected] .

Veterans

To be considered for any Veteran's Status , you MUST indicate this on your application.

RECENTLY SEPARATED VETERANS (RSV) : Effective July 1, 2009, legislation provides that the top five RSV applicants who apply and meet the qualifications for a vacancy shall be granted an interview. You must:
  1. Meet all Minimum Qualifications identified in this posting.
  2. Meet all of the RSV criteria.
  3. Submit a copy of your DD-214 form by the closing date to: [email protected]

Current State Employees
  • Current State Employees: Please note that employment provisions (including but not limited to seniority and leave accrual) vary among the three branches of Minnesota State government. When considering a job with another branch of state government, you are highly encouraged to explore these differences. For assistance, please direct questions to your current or anticipated Human Resources office.

Support to help you reach your career goals:
  • Training, classes, and professional development
  • Federal Public Service Loan ForgivenessProgram (Some positions may qualify for the Public Service Loan Forgiveness Program. For more information, visit the Federal Student Aid website at studentaid.gov )

Employee Assistance Program (EAP) for work/life support:
  • A voluntary confidential program that helps employees and their families with life challenges that may impact overall health, personal well-being, or job performance
  • Common sources of stress can be addressed through the EAP: mental health, relationship challenges (personal and work), grief and loss, finances, and legal issues
  • Daily Living/Convenience Services: Chore services, home repair, trip planning, child/elder care

Programs, resources and benefits eligibility variesbased on type of employment, agency, funding availability, union/collective bargaining agreement, location, and length of service with the State of Minnesota.

Similar Jobs

More Jobs at Minnesota Careers

More Information Technology Jobs

Find similar Senior Data Engineer - ITS4 jobs: