Qualifications

• Extensive hands-on experience in data engineering, particularly in Python and advanced SQL for production data applications.
• Deep expertise in Databricks environments, including Delta Lake, Unity Catalog, and PySpark.
• Proficiency in modeling data with dbt and managing infrastructure using Terraform for Infrastructure as Code.
• Experience migrating legacy systems (e.g., Teradata, Netezza) to modern cloud solutions, demonstrating results in real-world examples.
• Strong communication skills for interfacing confidently with both technical and executive teams in a consulting environment.

Responsibilities

• Serve as the primary technical authority on client engagements, scoping architectures and mapping data domains.
• Write and optimize production data code in PySpark and Databricks SQL, modernizing legacy logic into Medallion Architectures.
• Design secure data infrastructure that effectively integrates LLM workflows into enterprise pipelines.
• Develop modular Terraform scripts to provision cloud environments and manage governance.
• Lead nearshore engineering squads, conducting code reviews and ensuring adherence to high engineering standards.
• Act as a technical safety net, resolving issues promptly to maintain client project timelines.

Benefits

• Flexible working environment with opportunities for remote work.
• Collaboration with elite partners in the tech industry such as Databricks and Anthropic.
• Exposure to high-stakes, enterprise-level projects in prominent sectors like Financial Services and Healthcare.
• Professional growth opportunities in a fast-paced, startup-like atmosphere without rigid structures.