Azure Databricks Architect

Veracity Solutions

$120K — $160K *
Miami, FL 33186In-Person
Information Technology
11 - 15 years of experience
Job Overview by Ladders

Qualifications

  • 15+ years in data engineering, architecture, or platform engineering.
  • Hands-on experience with Azure Databricks, Spark, Python/Scala, SQL, and Delta Lake.
  • Proven track record in designing and implementing cloud data solutions.
  • Familiar with Azure DevOps, CI/CD, and deployment automation.
  • Hands-on technical implementation skills alongside oversight capabilities.
  • Excellent communication skills for stakeholder collaboration.

Responsibilities

  • Own the architecture for Azure Databricks-based data platforms, from ingestion to governance.
  • Design frameworks and data models for faster and more consistent delivery.
  • Build and optimize Spark jobs and data pipelines for performance and cost efficiency.
  • Architect solutions using Azure Databricks and related services like Delta Lake and ADLS.
  • Establish standards for governance, security, and code quality.
  • Collaborate with analysts and engineering teams to convert requirements into solutions.
  • Support troubleshooting and production environments for complex data workloads.

Benefits

  • Health, dental, and vision insurance.
  • 401(k) plan with company match.
  • Flexible work hours and potential remote working days.
  • Paid time off and holidays.
  • Continuous learning and professional development opportunities.
Full Job Description
Azure Databricks Architect
Full time
Miami, FL
Onsite

We are seeking zure Databricks Architect to define and lead the architecture of scalable, secure, and high-performance data platforms on Microsoft Azure. This role is hands-on and requires both architectural leadership and direct contribution to design, development, optimization, and delivery. The ideal candidate will shape platform strategy while actively building proof-of-concepts, reference implementations, and production-grade solutions.

Key responsibilities
  • Own the end-to-end architecture for Azure Databricks-based data platforms, including ingestion, transformation, storage, serving, and governance layers.
  • Design reusable frameworks, ELT patterns, and data models that improve delivery speed, consistency, and maintainability.
  • Build and optimize pipelines and Spark jobs directly, with a strong focus on performance, reliability, and cost efficiency.
  • Architect solutions using Azure Databricks, Delta Lake, ADLS, Azure Data Factory, and related Azure platform services.
  • Establish governance, security and code-quality standards for the platform.
  • Partner closely with business analysts, functional teams, and engineering teams to translate requirements into working solutions.
  • Guide troubleshooting, code reviews, and production support for complex data workloads.
  • Drive modernization and cloud-native adoption across data and analytics capabilities.
Must-have qualifications
  • 15+ years of experience in data engineering, data architecture, or platform engineering.
  • Strong hands-on experience with Azure Databricks, Spark, Python/Scala, SQL, and Delta Lake.
  • Proven experience designing and implementing cloud data hubs, data lakes, and analytical data stores.
  • Experience with Azure DevOps, CI/CD, and automated deployment practices.
  • Ability to work directly on technical implementation, not only provide oversight.
  • Strong communication and stakeholder collaboration skills.
Preferred qualifications
  • Experience in financial services or insurance.
  • Knowledge of Event Hub, Cosmos DB, Azure Synapse, or other Azure analytics services.
  • Databricks or Microsoft Azure certifications.
  • Experience with reusable frameworks, shell scripting, and production support in large-scale environments.

Similar Jobs

More Jobs at Veracity Solutions

More Information Technology Jobs

Find similar Azure Databricks Architect jobs: