Full Job Description
Our Capital Markets business unit is looking for two Databricks Engineers to join our existing team at a large, global bank. Successful candidates will work among a mixture of bank and Treliant staff in a hybrid role in the Greater New York City metro area.
Primary Location: Hybrid - Greater New York City metro area
Primary Location Salary Range: $160,000 - $200,000
Responsibilities
The client, a large bank, is in the process of centralizing its key reporting and aggregation processes on cloud platforms.
In 2024, the intention is to centralize cashflow aggregation onto a platform based on Databricks technologies (Databricks and Deltalake).
The project involves collecting both actual and forecast cashflows from both real-time and batch data sources, cleaning and enriching the data, and storing the resulting aggregated data in Deltalake for use in reporting.
Qualifications
Technical skills:
Successful candidates will have played an important role in at least one Databricks platform implementation. Experience in data migration, data integration, and delivery of data warehouses is also advantageous.
- Databricks: the candidate should be familiary with ETL/ELT in Databricks, with Medallion architecture and with Deltalake.
- Other relevant technologies include:
- Streaming technologies such as Kafka
- Delta Share and Deltalake Connector
- SQL, Python and PySpark
Domain knowledge:
The successful candidate will have a background in financial products and processes. Relevant areas of domain knowledge include:
- Cashflow forecasting and liquidity management
- Financial products including securities such as swaps, and banking products such as loans
- Reference data including counterparty and business hierarchy data
- Regulatory and risk management reporting needs
- Experience of the challenges of aggregating data in bulk across business units and asset classes
Other capabilities:
This role is likely to have an element of communication and leadership, rather than being purely a technical role within the team.
- The bank is at a relatively early stage in implementing the transition to Databricks.
- The role will involve guiding and understanding aspects of the migration such as cost management and use case prioritization.
- The role will involve communicating with data providers and data consumers to understand the requirements and to source and map the needed data fields.
Benefits
Treliant offers a comprehensive, total rewards package that includes competitive compensation and a flexible benefit package that reflects our commitment to creating a diverse and supportive workplace. In addition to a competitive base salary, candidate is eligible for incentive pay as well as a full range of health benefits, vacation plan, and 401k plan.