The Azure Databricks Platform Architect/Admin will be responsible for designing, implementing, and managing our Azure Databricks platform. The ideal candidate will have a strong background in Azure Databricks, data engineering, and data architecture, with a focus on building scalable and secure data platforms. The successful candidate will work closely with our data engineering and data science teams to ensure seamless integration of data pipelines and Lakehouse architecture. This role should ensure coding standard and coding migration to higher environment and CI/CD.
This is a Full Time, hybrid,
Platform Architect role located in Brentwood, TN.
What You'll Do- Design, implement, and manage our Azure Databricks platform, ensuring high availability, scalability, and security.
- Configure and optimize Databricks clusters, jobs, and notebooks for performance and cost-effectiveness.
- Maintain up to date architecture environment.
- Works with Azure and Databricks to resolved platform issues/tickets.
- Optimize cost / performance
- Collaborate with data engineering teams to design and implement/migrate data pipelines using using industry best practice.
- Automate manual admin tasks.
- Develop and maintain data Lakehouse architecture, ensuring data quality, integrity, and security. Work with Azure IAM and Engineering team to come up with RBAC for Databricks tables.
- Design and manage Lakehouse and sandbox environments for data science teams, ensuring data governance and security.
- Collaborate with data science teams to integrate data pipelines and Lakehouse architecture.
- Ensure Azure Databricks platform security and compliance with organizational security policies and regulatory requirements (e.g., HIPAA,NIST,GDPR).
- Implement data encryption, access controls, and auditing.
- Develop and maintain technical documentation for Azure Databricks platform, data pipelines, and Lakehouse architecture.
- Share knowledge and best practices with data engineering and data science teams.
- Other duties as assigned.
What You'll Bring- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- Certifications such as AWS Certified Solutions Architect, Cisco CCNP, Microsoft Azure Solutions Architect, or ITIL preferred.
- 5+ years of experience in IT infrastructure management, system administration, or network engineering, with a focus on data environments.
- Strong expertise in cloud platforms (AWS, Azure, GCP), virtualization, and networking.
- Experience with infrastructure automation tools (Terraform, Ansible, Kubernetes).
- Proficiency in Linux and Windows server administration.
- Solid knowledge of cybersecurity best practices and disaster recovery planning.
- Strong leadership experience in managing technical teams and project management skills.
- Knowledge of log management and monitoring tools (Splunk, Datadog, Prometheus).
- Familiarity with containerization and microservices.
Work-life balance is at the foundation of how decisions are made and where Premise is headed. We can only help people get, stay, and be well if we do the same for ourselves. In addition to competitive pay, Premise offers full-time team members benefits including medical, dental, vision, life and disability insurance, a 401(k) program with company match, paid holidays and vacation time, a company-sponsored wellness program, EAP, access to virtual primary care and virtual behavioral health at no cost for team members and their dependents. Additional benefits can be viewed here: https://jobs.premisehealth.com/benefits .
