Lead Software Engineer (Databricks Platform Engineer)

Vizient, Inc.

$117K — $206K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Relevant degree preferred, with an advanced degree in Computer Science, Engineering, Information Systems, or similar fields favored.
  • 7+ years of relevant experience in data platforms and engineering roles required.
  • 3+ years of hands-on experience specifically with Databricks platform solutions is essential.
  • Strong knowledge of Azure cloud services and cloud-native architectures is required.
  • Experience with Infrastructure-as-Code tools like Terraform, including CI/CD pipelines and automation.
  • Familiarity with Delta Lake, Unity Catalog, Apache Spark, and lakehouse architectures is necessary.
  • Experience in building reusable platform services and automation frameworks is needed.
  • Preferred experience with machine learning and AI platforms, including MLflow and MLOps.

Responsibilities

  • Lead the design, implementation, and evolution of the Databricks platform architecture.
  • Develop reusable services, engineering standards, and patterns for data analytics and AI.
  • Build Infrastructure-as-Code and CI/CD pipelines to enhance operational efficiency.
  • Create self-service tools and templates to ease platform onboarding and deployment.
  • Optimize platform scalability, security, and cost across cloud environments.
  • Enable machine learning capabilities with models and features in Databricks technologies.
  • Collaborate with cross-functional teams to deliver robust enterprise platform solutions.
  • Evaluate new Databricks features and technologies to recommend enhancements.

Benefits

  • Comprehensive benefits plan including health and wellness programs.
  • Incentive eligibility to align with performance outcomes.
  • Opportunities for professional development and certification support.
Full Job Description
Summary:

In this role, you will lead the design, engineering, and evolution of the enterprise Databricks platform as a strategic capability that enables analytics, data products, machine learning, and AI solutions across the organization. You will develop reusable platform services, automation frameworks, reference architectures, and self-service capabilities that accelerate delivery while aligning with enterprise architecture, governance, and engineering standards. You will collaborate with cross-functional teams to enhance developer experience, drive platform adoption, evaluate emerging technologies, and deliver scalable, secure, and cost-effective healthcare data and AI solutions.

Responsibilities:
  • Lead the design, implementation, and continuous evolution of the enterprise Databricks platform and supporting architecture.
  • Develop reusable platform services, reference architectures, engineering standards, and implementation patterns for analytics, data products, streaming, and AI workloads.
  • Build Infrastructure-as-Code, CI/CD pipelines, and automation frameworks to improve platform scalability, reliability, and operational efficiency.
  • Create self-service capabilities, reusable templates, and engineering accelerators that simplify platform onboarding and deployment.
  • Optimize platform performance, scalability, security, governance, and cost efficiency across cloud environments.
  • Enable machine learning and AI platform capabilities by implementing patterns for MLflow, Model Registry, Feature Store, Vector Search, and other Databricks technologies.
  • Partner with Enterprise Architecture, Data Engineering, Product Management, Cloud Engineering, Data Science, and client stakeholders to deliver enterprise platform capabilities.
  • Evaluate emerging Databricks features and cloud technologies, lead proof-of-concepts, and recommend platform enhancements that support business objectives.
  • Provide technical leadership, mentoring, and engineering guidance while promoting Platform-as-a-Product principles and engineering best practices.
  • Drive continuous improvement through automation, innovation, and adoption of enterprise platform standards.


Qualifications:
  • Relevant degree preferred. Advanced degree in Computer Science, Engineering, Information Systems, or a related field preferred.
  • 7 or more years of relevant experience required.
  • 3 or more years of hands-on experience designing, implementing, and supporting Databricks platform solutions required.
  • Strong experience with Azure cloud services, cloud-native architectures, and enterprise platform engineering required.
  • Experience with Terraform, Infrastructure-as-Code, and CI/CD pipelines, and infrastructure automation.
  • Strong knowledge of Delta Lake, Unity Catalog, Apache Spark, and lakehouse architectures.
  • Experience developing reusable platform services, automation frameworks, self-service capabilities, and engineering accelerators.
  • Experience supporting machine learning and AI platform capabilities, including MLflow, Model Registry, Feature Store, Vector Search, or MLOps practices preferred.
  • Databricks certification, experience with streaming and event-driven architectures, enterprise-scale data platforms, or healthcare industry experience preferred.


Estimated Hiring Range:
At Vizient, we consider skills, experience, and organizational needs in our compensation approach. Geographic factors may adjust the range estimate and hires typically fall below the top range. Compensation decisions are tailored to individual circumstances. The current salary range for this role is $117,600.00 to $206,000.00.

This position is also incentive eligible.

Vizient has a comprehensive benefits plan! Please view our benefits here:

http://www.vizientinc.com/about-us/careers

Similar Jobs

More Jobs at Vizient, Inc.

  • Agile Product Owner
    $68K — $116K *
    Chicago, IL 60629 (Cook County)
    Healthcare
    In-Person
  • Product Advisor
    $68K — $116K *
    Cape Girardeau, MO 63701 (Cape Girardeau County)
    Healthcare
    In-Person
  • Product Advisor
    $68K — $116K *
    Chicago, IL 60629 (Cook County)
    Healthcare
    In-Person
  • Product Advisor
    $68K — $116K *
    Centennial, CO 80015 (Arapahoe County)
    Healthcare
    In-Person
  • AVP, Thought Leadership
    $156K — $290K *
    Chicago, IL 60629 (Cook County)
    Healthcare
    In-Person

More Information Technology Jobs

Find similar Lead Software Engineer (Databricks Platform Engineer) jobs: