Technology Lead - Azure and Databricks Admin

Infosys Limited Digital$110K — $130K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of total IT experience required, with a focus on Databricks administration.
  • Demonstrated ability to manage Azure Databricks environments is preferred, along with experience in AWS and GCP.
  • A Bachelor’s degree in a technical field or equivalent experience is required; additional experience can substitute for education.
  • Candidates must be authorized to work in Canada and preferably located near Calgary, Alberta.

Responsibilities

  • Administer and manage multiple Databricks workspaces across different environments.
  • Configure and maintain essential Databricks components such as workspaces, clusters, and security policies.
  • Implement and manage Unity Catalog for governance and access controls.
  • Perform regular platform health checks and maintenance tasks, including upgrades.
  • Monitor cluster performance, troubleshoot issues, and optimize resource usage.

Benefits

  • Opportunity to work with cutting-edge cloud technologies across multiple platforms.
  • Engagement with a collaborative team in a global delivery model.
  • Supportive company culture emphasizing documentation and knowledge sharing.
Full Job Description
Job Description

We are seeking an experienced Databricks Platform Administrator to manage, secure, optimize, and support enterprise Databricks environments across cloud platforms. The ideal candidate will be responsible for workspace administration, cluster management, security governance, cloud integrations, platform monitoring, automation, and operational support. This role requires strong expertise in Azure Databricks (preferred), along with exposure to AWS and GCP Databricks environments.

Required Qualifications:
  • Candidates authorized to work for any employer in Canada without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time.
  • Candidate must be located within commuting distance of Calgary, Alberta or be willing to relocate to the areas.
  • Bachelor's degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
  • At least 4 years of Information Technology experience

Key Responsibilities
Platform Administration
  • Administer and manage Databricks workspaces across development, test, and production environments.
  • Configure and maintain Databricks workspaces, metastore, catalogs, clusters, pools, and policies.
  • Manage Unity Catalog implementation, governance, and access controls.
  • Perform platform upgrades, maintenance, and health checks.
  • Support multi-workspace and multi-region deployments.
Cluster Management
  • Create, configure, and manage all-purpose and job clusters.
  • Implement cluster policies to control costs and ensure compliance.
  • Optimize cluster sizing and auto-scaling configurations.
  • Monitor cluster utilization, performance, and cost efficiency.
  • Troubleshoot cluster startup, termination, and execution issues.
Security & Governance
  • Implement RBAC and workspace access controls.
  • Integrate Databricks with Azure AD, AWS IAM, or GCP Identity services.
  • Manage service principals, managed identities, and secret scopes.
  • Implement Unity Catalog governance and data security policies.
  • Support audit logging, compliance, and platform security reviews.
Cloud Integration
  • Integrate Databricks with:
    • Azure Data Lake Storage (ADLS)
    • AWS S3
    • Azure Key Vault
    • AWS Secrets Manager
    • SQL Databases
    • Event Hub
    • Kafka
    • Snowflake
    • Power BI
Monitoring & Performance
  • Monitor platform health and resource utilization.
  • Establish proactive alerting and monitoring mechanisms.
  • Analyze Spark job performance and recommend optimizations.
  • Troubleshoot platform incidents and performance bottlenecks.
  • Support SLA-driven production environments.
DevOps & Automation
  • Automate Databricks administration using:
    • Terraform
    • Azure DevOps
    • GitHub Actions
    • Databricks CLI
    • REST APIs
  • Manage CI/CD pipelines for Databricks deployments.
  • Support Infrastructure as Code (IaC) initiatives.
Operational Support
  • Participate in incident, problem, and change management activities.
  • Support patching, upgrades, certificate renewals, and maintenance activities.
  • Create and maintain SOPs, runbooks, and technical documentation.
  • Collaborate with engineering, infrastructure, security, and application teams.

Required Skills
Databricks
  • Databricks Workspace Administration
  • Unity Catalog
  • Cluster Management
  • Cluster Policies
  • Instance Pools
  • Jobs & Workflows
  • SQL Warehouses
  • Databricks CLI
  • REST APIs
  • Delta Lake
Cloud Platforms
  • Azure Databricks (Preferred)
  • AWS Databricks
  • GCP Databricks

Preferred Skill and Experience
  • Experience with enterprise-scale Azure Databricks environments.
  • Strong understanding of data lake architecture and governance frameworks.
  • Experience supporting production environments with strict SLA requirements.

Soft Skills
Strong analytical and troubleshooting skills.
Excellent communication and stakeholder coordination.
Ability to work in a global delivery model.
Documentation and knowledge-sharing mindset.

Experience
  • 8-10 years of experience in IT Industry
  • 5+ years of Databricks Administration experience.
  • Prior experience in large enterprise or managed services engagements preferred.
  • Exposure to Infosys-scale delivery environments is an advantage.
The job entails sitting as well as working at a computer for extended periods of time. Should be able to communicate by telephone, email or face to face. Travel may be required as per the job requirements

About Infosys Limited Digital

Infosys Limited Digital Careers

Joining Infosys Limited Digital offers a unique opportunity to be part of a global team of professionals who are at the forefront of digital innovation and transformation. Infosys Limited Digital is renowned for its commitment to leadership in technology services and consulting, making it an ideal place for ambitious individuals seeking growth and career advancement.

Explore Job Opportunities

Infosys Limited Digital is actively seeking talented individuals to join their team. With a variety of job opportunities available, candidates can find positions that match their skills and interests. The company values diversity and inclusivity, ensuring that all team members have the opportunity to contribute to their fullest potential.

Experience Professional Growth

At Infosys Limited Digital, professional growth is a priority. The company offers comprehensive benefits and diversity training programs that support both personal and professional development. Employees are encouraged to take leadership roles within projects, fostering a culture of innovation and continuous improvement.

Engage in Meaningful Work

Employees at Infosys Limited Digital engage in projects that transform businesses and industries worldwide. By leveraging cutting-edge technology and deep industry expertise, the team delivers solutions that meet the complex demands of today's digital landscape.

Internship Programs

For those starting their careers, Infosys Limited Digital’s internship programs provide a robust platform for learning and development. Interns gain hands-on experience, working alongside seasoned professionals on real-world projects. This not only enhances their skills but also prepares them for future employment opportunities within the company.

Join a Collaborative Team

Infosys Limited Digital prides itself on its collaborative culture. Team members from around the globe come together to share ideas and strategies, ensuring the best outcomes for clients and stakeholders. Networking within the company is highly encouraged, opening doors to myriad opportunities for career advancement.

Prepare for Your Interview

When applying for a position at Infosys Limited Digital, it is crucial to tailor your resume to highlight relevant experience and skills. Preparation for the interview process is key, as it is a chance to demonstrate how your background aligns with the company’s needs and values.

Stay Connected with Career Insights

Keep up to date with the latest in career opportunities and industry trends by subscribing to Infosys Limited Digital’s career blog. Gain insights from insiders and stay informed about new openings and company news.

Apply Now

Discover the exciting and rewarding career opportunities at Infosys Limited Digital. Search for open positions that align with your professional skills and interests. Infosys Limited Digital is looking for passionate, curious, and innovative team players ready to make a significant impact in the digital world.

SEARCH INFOSYS LIMITED DIGITAL JOBS

READ CAREERS BLOG

Job Alert Emails

Customize your subscription to receive job alerts and insider tips tailored to your preferences. Explore the diverse and dynamic career paths available at Infosys Limited Digital.
Learn more about Infosys Limited Digital

Similar Jobs

More Jobs at Infosys Limited Digital

More Information Technology Jobs

Find similar Technology Lead - Azure and Databricks Admin jobs: