Treliant

Databricks Engineer

Treliant$160K — $200K *
Finance & Insurance
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of experience with Databricks implementation
  • Familiarity with ETL/ELT processes and Medallion architecture
  • Experience with streaming technologies like Kafka
  • Proficiency in SQL, Python, and PySpark
  • Background in financial products and processes, particularly cashflow forecasting
  • Knowledge of regulatory and risk management reporting needs
  • Ability to communicate technical requirements and guide project transitions

Responsibilities

  • Centralize cashflow aggregation using Databricks technologies
  • Collect and clean both actual and forecast cashflows from diverse data sources
  • Enrich data and store aggregated results in Delta Lake
  • Guide the migration to Databricks including cost management
  • Map data fields by communicating with data providers and consumers
  • Support the overall transition to cloud-based reporting processes

Benefits

  • Comprehensive total rewards package
  • Flexible benefits tailored to diverse needs
  • Eligibility for incentive pay
  • Full range of health benefits
  • Generous vacation plan
  • 401k plan with employer contribution
Full Job Description
Our Capital Markets business unit is looking for two Databricks Engineers to join our existing team at a large, global bank. Successful candidates will work among a mixture of bank and Treliant staff in a hybrid role in the Greater New York City metro area. Primary Location: Hybrid - Greater New York City metro area Primary Location Salary Range: $160,000 - $200,000 Responsibilities The client, a large bank, is in the process of centralizing its key reporting and aggregation processes on cloud platforms. In 2024, the intention is to centralize cashflow aggregation onto a platform based on Databricks technologies (Databricks and Deltalake). The project involves collecting both actual and forecast cashflows from both real-time and batch data sources, cleaning and enriching the data, and storing the resulting aggregated data in Deltalake for use in reporting. Qualifications Technical skills: Successful candidates will have played an important role in at least one Databricks platform implementation. Experience in data migration, data integration, and delivery of data warehouses is also advantageous. - Databricks: the candidate should be familiary with ETL/ELT in Databricks, with Medallion architecture and with Deltalake. - Other relevant technologies include: - Streaming technologies such as Kafka - Delta Share and Deltalake Connector - SQL, Python and PySpark Domain knowledge: The successful candidate will have a background in financial products and processes. Relevant areas of domain knowledge include: - Cashflow forecasting and liquidity management - Financial products including securities such as swaps, and banking products such as loans - Reference data including counterparty and business hierarchy data - Regulatory and risk management reporting needs - Experience of the challenges of aggregating data in bulk across business units and asset classes Other capabilities: This role is likely to have an element of communication and leadership, rather than being purely a technical role within the team. - The bank is at a relatively early stage in implementing the transition to Databricks. - The role will involve guiding and understanding aspects of the migration such as cost management and use case prioritization. - The role will involve communicating with data providers and data consumers to understand the requirements and to source and map the needed data fields. Benefits Treliant offers a comprehensive, total rewards package that includes competitive compensation and a flexible benefit package that reflects our commitment to creating a diverse and supportive workplace. In addition to a competitive base salary, candidate is eligible for incentive pay as well as a full range of health benefits, vacation plan, and 401k plan.

About Treliant

Treliant provides consulting services to the financial services industry. The company offers services in the areas of regulatory compliance, risk management, mortgage operations, financial crimes, and litigation support. Treliant serves banks, mortgage companies, consumer and commercial finance companies, and other financial institutions. The company was founded in 1989 and is headquartered in Washington, DC.
Learn more about Treliant
Size
200 employees
Industry
Founded
1989
5 Year Trend
-5%
Revenue
$25 million

Similar Jobs

More Jobs at Treliant

More Finance & Insurance Jobs

Find similar Databricks Engineer jobs: