About the role

We are seeking a skilled and proactive Databricks Platform Engineer to join our team. The ideal candidate will be responsible for owning, managing, optimizing, and supporting our Databricks platform end-to-end, including Azure-based deployments and supporting infrastructure-as-code and CI/CD practices. Experience with cloud networking and integration with downstream analytics tooling (including Power BI) is essential to ensure the reliability, security, and performance of our big data and analytics infrastructure.

What you'll do here:

• Administer, configure, and maintain Azure Databricks workspaces, including user management, cluster setup, resource allocation, provisioning cloud services, and backup and recovery strategy.

• Own and evolve platform automation, including Infrastructure as Code (Terraform) and Azure DevOps CI/CD pipelines for Databricks and dependent cloud resources.

• Monitor system performance and troubleshoot issues related to Databricks clusters, jobs, and data pipelines.

• Implement best practices for security, compliance, and cost management within Azure Databricks environments.

• Collaborate with data engineers, data scientists, and other stakeholders to support their workflows and optimize platform usage, including Power BI and dashboard administration.

• Partner with cloud networking and security teams to design and operate secure connectivity patterns (VNets/subnets, routing/DNS, Private Link, VNet injection), especially for environments isolated from the public internet.

• Integrate Databricks with various SaaS products and services, ensuring seamless data flow and interoperability.

• Administer and maintain Power BI workspaces, datasets, and reports, ensuring effective data visualization and reporting capabilities.

• Automate routine administrative tasks using scripting (Python and/or Bash) and Databricks REST APIs.

• Manage data access controls, auditing, and monitoring to maintain data integrity and privacy.

• Stay current with new features, updates, and best practices in Databricks, Azure, and relevant SaaS platforms.

• Document procedures, configurations, and troubleshooting steps for internal knowledge sharing.

What you bring to the table:

• Bachelor’s degree in Computer Science, Information Technology, or a related field (or equivalent experience).

• Proven experience administering Azure Databricks (or cross-cloud equivalent), including workspace setup, cluster management, and performance tuning.

• Solid understanding of Azure cloud services (e.g., Azure Data Lake, Azure Synapse Analytics, Entra, Azure DevOps).

• Proficiency with Infrastructure as Code using Terraform (preferred), and experience working with CI/CD pipelines to deploy and manage cloud resources.

• Working knowledge of cloud infrastructure concepts—storage, networking, and identity and access management (IAM)—including applied experience with VNets/subnets and Private Link (or cross-cloud equivalents).

• Experience integrating and managing SaaS products within a cloud-based data ecosystem.

• Strong scripting and automation skills (Python and/or Bash).

• Knowledge of big data concepts, Spark architecture, and ETL processes.

• Familiarity with data security, compliance, and governance best practices.

• Agility, innovation, responsiveness and a continuous improvement mindset through proactive problem-solving and ownership of outcomes.

• Able to effectively manage competing demands, rapidly shifting priorities, and high-pressure moments.

• Relevant certifications (e.g., Azure Administrator, Databricks Certified Associate) are a plus.