Senior Engineer will be a key member of the Azure Data as a Service (DaaS) team responsible for designing, implementing, supporting, and optimizing Azure-based data platforms and services. The role will initially focus on Azure Databricks platform engineering and operations while also supporting broader Azure data services, automation, governance, security, and cloud modernization initiatives.
Responsibilities- Administer, maintain, and optimize Azure Databricks environments, including workspace configuration, cluster management, and workload monitoring.
- Support Lakehouse solutions and data architecture using Azure Databricks and Azure Data Lake Storage.
- Optimize platform performance through cluster tuning, Delta Lake optimization, and workload analysis.
- Troubleshoot and resolve Databricks platform, data pipeline, and performance issues.
- Implement and support Unity Catalog, access controls, and data governance capabilities.
- Configure and maintain Azure security controls including RBAC, Managed Identities, Private Endpoints, Key Vault, and Azure Policy.
- Monitor platform utilization and identify opportunities for cost optimization and operational efficiency.
- Support enterprise Azure data services including Azure Data Factory, Azure SQL Database, Azure Cosmos DB, Azure Database for PostgreSQL, and Azure Synapse Analytics.
- Monitor platform health, availability, reliability, and performance across Azure data services.
- Investigate incidents and collaborate with infrastructure, networking, security, and engineering teams to resolve operational issues.
- Design, implement, and support ETL/ELT and data integration solutions using Azure Data Factory and Azure Databricks.
- Develop automation and Infrastructure as Code (IaC) solutions using Bicep, Terraform, Azure DevOps, and Git-based CI/CD practices.
- Provide technical support and guidance to application teams onboarding Azure data platform services.
- Participate in on-call rotation to provide support for business applications during business and off-business hours
Qualifications- Hands-on experience designing, implementing, and supporting Azure data platforms, including Azure Databricks and services such as ADLS Gen2, Azure SQL, Azure Data Factory, Cosmos DB, and similar technologies.
- Experience administering Azure Databricks, including cluster management, performance optimization, Unity Catalog, and Lakehouse architecture.
- Experience with cloud security, governance, and data management, including access controls, metadata management, cataloging, and data lineage.
- Experience troubleshooting and optimizing cloud platforms, databases, and data processing workloads.
- Experience with Infrastructure as Code (IaC), automation, and DevOps using Bicep, Terraform, Ansible, or similar tools.
- Strong analytical, problem-solving, communication, and collaboration skills with the ability to work across technical and business Desired Qualifications
Desired Qualifications- Bachelor's degree in computer science, Information Technology, Engineering, or a related field, or equivalent combination of education and experience.
- Experience with data governance, metadata management, or data catalog solutions such as Microsoft Purview, Alation, Atacaama, Collibra, or similar technologies.
- Exposure to AI/ML platforms, AI Foundry, or modern analytics and data science workloads.
- Experience with cloud cost optimization, FinOps practices, or capacity planning.
- Microsoft Azure certifications such as Azure Data Engineer Associate, Azure Solutions Architect Expert, or related certifications.
Additional InformationHours:- Monday - Friday, 8:00AM - 4:30PM
Location:- 820 Follin Lane, Vienna, VA 22180
- 5510 Heritage Oaks Drive, Pensacola, FL 32526
- 141 Security Drive, Winchester, VA 22602
