Data Engineer - Databricks

Groundswell Agriculture Festival

$89K — $175K *
US-Anywhere
+ 3 other locationsRemote
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor’s degree in Computer Science, Computer Engineering, Mathematics, Statistics, or related technical field.
  • 5+ years of experience in data engineering, database administration, or database development.
  • Hands-on Databricks experience is essential.
  • Experience with SQL Server and/or MariaDB enterprise databases.
  • Advanced SQL skills for developing and optimizing database objects.
  • Proficiency in Python, Java, or Scala required.
  • Experience in ETL/ELT pipeline development using tools like Apache Airflow or AWS Glue.
  • Strong stakeholder engagement and communication skills.

Responsibilities

  • Design and implement scalable Databricks solutions and ETL/ELT pipelines.
  • Apply Databricks standards and engineering best practices effectively.
  • Administer and monitor enterprise MariaDB and SQL Server environments.
  • Perform database configuration, backup, restoration, and performance tuning.
  • Collaborate with business and technical teams to translate requirements.
  • Troubleshoot complex database and data pipeline issues efficiently.
  • Deliver technical demonstrations and provide training on solutions.

Benefits

  • Comprehensive medical, dental, and vision plans.
  • Flexible Spending Account available.
  • 4% 401K match with immediate vesting.
  • Paid Time Off for a healthy work-life balance.
  • Tuition reimbursement and professional development programs.
  • Flexible work schedule to accommodate personal needs.
  • On-site gym and childcare option to support family well-being.
Full Job Description

What You'll do:

Groundswell is hiring an experienced Data Engineer to join our team supporting the Department of Transportation (DOT). This customer-facing role combines data engineering and database administration across MariaDB, SQL Server, and Databricks environments.

Responsibilities:

  • Design and implement scalable Databricks solutions and ETL/ELT pipelines.

  • Apply Databricks development standards and data engineering best practices.

  • Administer and monitor enterprise MariaDB and SQL Server environments.

  • Design databases, schemas, tables, views, stored procedures, functions, and triggers.

  • Perform database configuration, backup, restoration, performance tuning, and disaster recovery.

  • Optimize SQL queries, indexes, database objects, pipelines, and server performance.

  • Configure and support availability groups, mirroring, clusters, encryption, and reporting servers.

  • Apply best practices for data modeling, relational database design, data warehousing, data quality, and lineage.

  • Implement database security, auditing, user access, roles, permissions, and domain-level accounts.

  • Troubleshoot complex database, application, and data pipeline issues.

  • Collaborate with business stakeholders, infrastructure, network, application, development, and vendor teams.

  • Translate business and technical requirements into secure, scalable data solutions.

  • Deliver technical demonstrations and training and support proposal efforts.

Required Qualifications

  • Bachelor’s degree in Computer Science, Computer Engineering, Mathematics, Statistics, or a related technical field.

  • 5+ years of experience in data engineering, database administration, or database development.

  • Demonstrated hands-on Databricks experience.

  • Experience administering SQL Server and/or MariaDB enterprise databases.

  • Advanced SQL skills, including developing and optimizing queries, stored procedures, functions, triggers, tables, and views.

  • Proficiency in Python, Java, or Scala.

  • Experience developing ETL/ELT pipelines using tools such as Apache Airflow, AWS Glue, or similar technologies.

  • Experience with database performance tuning, backup and restoration, disaster recovery, security, and access management.

  • Strong stakeholder engagement, communication, collaboration, and problem-solving skills.

  • Demonstrated experience leading or providing technical direction to engineering teams.

  • U.S. citizenship and the ability to obtain and maintain a federal Public Trust per contract requirements.

Preferred Qualifications

  • Experience with both SQL Server and MariaDB.

  • Experience with AWS services and cloud architecture.

  • Experience with medallion data architecture, including Bronze, Silver, Gold, and Platinum layers.

  • Experience with MicroStrategy and/or Tableau.

  • Experience with LLM data requirements, vector databases, or AI model deployment.

  • Current or previously held federal Public Trust.

  • Previous experience supporting DOT or related federal systems.


Skills:


Certification:

Why You’ll Never Want to Leave:

  • Comprehensive medical, dental, and vision plans 
  • Flexible Spending Account 
  • 4% 401K Match (immediate vesting) 
  • Paid Time Off 
  • Tuition reimbursement, certification programs, and professional development
  • Flexible work schedule
  • On-site gym and childcare option 

The salary range for this role takes into account the wide range of factors that are considered in making compensation decisions, including but not limited to skill sets, experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for any applicable geographic differential associated with the location at which the position may be filled. At Groundswell, it is not typical for an individual to be hired at or near the top of the range for their role, and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is:

$89,886.00 - $175,444.00


NOTEGroundswell does not accept unsolicited resumes through or from search firms or staffing agencies. All unsolicited resumes will be considered the property of Groundswell, and Groundswell will not be obligated to pay a placement fee.

Similar Jobs

More Jobs at Groundswell Agriculture Festival

  • Business Analyst
    $74K — $142K *
    Remote
    Transportation
    Remote
  • Business Analyst
    $74K — $142K *
    Washington, DC 20011 (District Of Columbia County)
    Education, Government & Non-Profit
    In-Person
  • Collibra Developer
    $116K — $164K *
    Washington, DC 20011 (District Of Columbia County)
    Enterprise Technology
    In-Person
  • Collibra Developer
    $116K — $164K *
    Remote
    Information Technology
    Remote
  • PMO Analyst
    $74K — $158K *
    Maryland, NY 12116 (Otsego County)
    Aerospace & Defense
    In-Person

More Information Technology Jobs

Find similar Data Engineer - Databricks jobs: