Qualifications

• 8+ years of experience in data or software engineering, especially with large-scale financial data.
• Strong SQL and hands-on experience with BigQuery or a similar data warehouse.
• Proficient in Python and/or Java for developing data pipelines.
• Familiarity with GCP tools including BigQuery, Cloud Composer/Airflow, and Dataflow.
• Experience in building machine learning models with LLMs, including prompt engineering and function/tool calling.
• Solid understanding of ETL/ELT architecture, data modeling, and performance tuning in large environments.
• Excellent communication skills for translating business needs into technical specifications.

Responsibilities

• Develop and maintain scalable data pipelines to manage large transactional datasets.
• Implement and optimize ETL/ELT processes for efficient data flow.
• Work directly with stakeholders from various departments to gather requirements and deliver solutions.
• Build machine learning applications using LLMs within the data infrastructure.
• Conduct performance tuning to optimize data processing and querying.
• Adapt to quickly changing priorities and troubleshoot production issues as they arise.

Benefits

• Opportunity to work with cutting-edge technologies and tools in the data engineering space.
• Collaborative work environment with cross-functional teams including non-technical stakeholders.
• Mentorship and professional development opportunities in a rapidly evolving field.