Senior Data Platform Engineer

Reply

$135K — $155K *
Finance & Insurance
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of hands-on Databricks experience, focusing on building platform capabilities.
  • Proficient in Python and SQL programming languages.
  • Experience with infrastructure as code using Terraform and CI/CD practices.
  • Knowledge of data governance and observability frameworks, such as Unity Catalog.
  • Strong background in workflow orchestration using Apache Airflow (experience with Astro/Astronomer preferred).
  • Skilled in building and operating data pipelines to integrate various data sources.
  • Ability to create reusable, self-service data products for end-users.

Responsibilities

  • Design, build, and enhance platform capabilities within Databricks.
  • Evaluate and adopt new platform features and technologies.
  • Improve system governance, automation, and security practices.
  • Define target-state architecture for custom platforms.
  • Utilize AI agents for system design and operation, knowing when to trust them.

Benefits

  • Comprehensive health insurance plans.
  • Retirement savings options with company matching.
  • Flexible work schedules and remote work opportunities.
  • Professional development and training resources.
  • Wellness programs and employee assistance initiatives.
Full Job Description
This role sits at the intersection of platform engineering, data engineering, and data product development within financial services applications. Leading with platform engineering - and with data engineering as the assumed foundation - the engineer builds reusable platform capabilities and data products that let quantitative researchers discover, access, and consume data across a complex, disparate landscape, and then accelerates the good prototypes to production. • Design, build, and enhance platform capabilities within Databricks and related technologies. • Evaluate and adopt emerging platform features and technologies; run the self-assessments and technology evaluations research initiatives depend on. • Improve governance, automation, observability, security, and operational excellence. • Help define the target-state architecture for custom platform. • Work through AI agents by default. Use agentic tools to design, build, test, and operate, and know when to trust them versus verify. Required Skills • Hands-on Databricks experience across workspace, notebooks, and jobs, plus building platform capabilities on it (not just using it). • Strong Python and SQL. • Platform-engineering foundation: infrastructure as code with Terraform and modern CI/CD. • Data governance and observability in a managed environment (e.g. Unity Catalog, lineage, monitoring). • Strong workflow orchestration experience with Apache Airflow (we use Astro / Astronomer). • Building and operating data pipelines that integrate disparate, heterogeneous data sources. • Building reusable, self-service data products for non-engineer end users (researchers/analysts). • An AI-first mindset: fluent with agentic coding tools (e.g. Claude Code) and eager to make them central to how the team works. The base compensation range for this full-time position is between $135,000 - $155,000 plus benefits. Compensation decisions are supported through market data, where regional variances may exist based on cost of labor. We also take into consideration prior experience, relevant skills, education and/or training, certifications and, as applicable, other required qualifications. If you have questions regarding compensation, the talent acquisition team can provide relevant details during the interview process.

Similar Jobs

More Jobs at Reply

More Finance & Insurance Jobs

Find similar Senior Data Platform Engineer jobs: