Senior Data Platform Engineer

Reply

$135K — $155K *
Finance & Insurance
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Hands-on experience with Databricks, specifically in building platform capabilities.
  • Proficient in Python and SQL programming languages.
  • Strong foundation in platform engineering and infrastructure as code, particularly with Terraform.
  • Knowledge of data governance and observability frameworks in cloud environments.
  • Experience in workflow orchestration, especially with Apache Airflow.
  • Skilled in integrating diverse data sources into operational data pipelines.
  • Ability to create self-service data products for users without engineering backgrounds.
  • Familiarity with AI-driven coding tools and methodologies.

Responsibilities

  • Design and build platform capabilities using Databricks and related technologies.
  • Evaluate and implement emerging platform features and conduct technology assessments.
  • Enhance operational elements like governance, automation, and security throughout the platform.
  • Define the architectural vision for the platform's target state.
  • Utilize AI agents to design, build, test, and operate platform capabilities effectively.

Benefits

  • Comprehensive benefits package including health, dental, and vision insurance.
  • Opportunities for professional development and training.
  • Flexible work arrangements to support work-life balance.
  • Access to cutting-edge tools and technologies in the field.
  • Collaborative environment promoting innovation and continuous improvement.
Full Job Description
This role sits at the intersection of platform engineering, data engineering, and data product development within financial services applications. Leading with platform engineering - and with data engineering as the assumed foundation - the engineer builds reusable platform capabilities and data products that let quantitative researchers discover, access, and consume data across a complex, disparate landscape, and then accelerates the good prototypes to production. • Design, build, and enhance platform capabilities within Databricks and related technologies. • Evaluate and adopt emerging platform features and technologies; run the self-assessments and technology evaluations research initiatives depend on. • Improve governance, automation, observability, security, and operational excellence. • Help define the target-state architecture for custom platform. • Work through AI agents by default. Use agentic tools to design, build, test, and operate, and know when to trust them versus verify. **Required Skills** • Hands-on Databricks experience across workspace, notebooks, and jobs, plus building platform capabilities on it (not just using it). • Strong Python and SQL. • Platform-engineering foundation: infrastructure as code with Terraform and modern CI/CD. • Data governance and observability in a managed environment (e.g. Unity Catalog, lineage, monitoring). • Strong workflow orchestration experience with Apache Airflow (we use Astro / Astronomer). • Building and operating data pipelines that integrate disparate, heterogeneous data sources. • Building reusable, self-service data products for non-engineer end users (researchers/analysts). • An AI-first mindset: fluent with agentic coding tools (e.g. Claude Code) and eager to make them central to how the team works. The base compensation range for this full-time position is between $135,000 - $155,000 plus benefits. Compensation decisions are supported through market data, where regional variances may exist based on cost of labor. We also take into consideration prior experience, relevant skills, education and/or training, certifications and, as applicable, other required qualifications. If you have questions regarding compensation, the talent acquisition team can provide relevant details during the interview process.

Similar Jobs

More Jobs at Reply

More Finance & Insurance Jobs

Find similar Senior Data Platform Engineer jobs: