Senior Databricks Platform Architect / Lead

49 Solutions is seeking a Senior Databricks Platform Architect / Lead to provide technical leadership for the design and implementation of secure, enterprise-scale Databricks environments supporting Government of Canada data, analytics and AI initiatives. Responsibilities • Lead the architecture and implementation of enterprise Databricks platforms within Microsoft Azure. • Define target-state Lakehouse, workspace and Unity Catalog architectures. • Design secure foundations supporting data engineering, Databricks SQL, BI, analytics, AI and machine learning workloads. • Establish architectural patterns for Delta Lake, Lakeflow, Databricks SQL and Unity Catalog. • Design integration with cloud, enterprise and on-premises data sources. • Work with Azure cloud and network specialists on VNet injection, Private Link, routing and secure connectivity. • Define identity and access patterns using Microsoft Entra ID, SCIM and role-based access controls. • Guide platform security approval, governance, classification, lineage, auditing and cost controls. • Provide technical direction to data engineering, DevOps, security, networking and governance resources. • Lead discovery sessions, architecture workshops and design reviews with federal stakeholders. • Develop reusable architectures, implementation standards, runbooks and knowledge-transfer materials. Requirements Mandatory Qualifications • A minimum of 10 years of professional experience working in the IT industry or performing IT-related roles. • A valid and active Government of Canada Reliability, Secret or Top Secret security clearance. • Significant experience designing enterprise data, cloud or analytics platforms. • Demonstrated hands-on Databricks and Microsoft Azure experience. • Experience with Databricks workspaces, Delta Lake, Unity Catalog and enterprise ETL/ELT architecture. • Strong knowledge of cloud networking, identity, security and data governance. • Experience leading complex technical delivery and preparing architecture documentation. • Strong client-facing consulting and communication skills. Technical Skills • Databricks Lakehouse • Unity Catalog • Delta Lake • Lakeflow • Databricks SQL • Apache Spark / PySpark • Python and SQL • Microsoft Azure • Microsoft Entra ID • Cloud networking and security • Enterprise data architecture • Data governance • CI/CD and DevOps concepts Assets • Government of Canada Databricks implementations • Protected B, ITSG-33, PBMM, SA&A or ATO • Microsoft Purview • Terraform and Databricks Asset Bundles • Migration from SAS, Synapse, DataStage, DB2, Oracle, Teradata or Netezza • Databricks AI/BI, Genie, MLflow or Mosaic AI • Bilingualism in English and French Certifications Target Certification • Databricks Certified Data Engineer Professional or another advanced Databricks certification directly relevant to solution architecture. Candidates who do not currently hold the target certification may still be considered based on their experience. Candidates are not expected to obtain the certification immediately while 49 Solutions is building its prospective team. If a specific certification becomes required for an opportunity, candidates must be willing to obtain it at their own expense before being submitted for that opportunity. Additional Asset Certifications • Microsoft Certified: Azure Solutions Architect Expert • Databricks Solutions Architect training or accreditation • Databricks Platform Administrator accreditation • Databricks Data & AI Governance with Unity Catalog training • Databricks EDW/ETL migration training • TOGAF or equivalent Security Requirement Candidates must hold a valid and active Government of Canada Reliability, Secret or Top Secret security clearance. Location Ottawa, Ontario, Canada. Engagements may be remote, hybrid, or performed at a Government of Canada location. Candidates located in Toronto or Montreal are also encouraged to apply, provided they are willing and able to travel to Ottawa for onsite meetings approximately once per month, as required. Work arrangements will depend on the client, project and security requirements.