Solution Architect - Azure Databricks Job Title: Solution Architect - Data Engineering (Azure Databricks)
Experience: 10+ Years
Education: Bachelor's Degree (4-year) - Computer Science / Engineering / Related Field
Domain: US Healthcare (Preferred)
Role OverviewWe are seeking a Solution Architect to design and drive enterprise-scale data engineering architectures on Azure Databricks and cloud platforms. This role will define end-to-end data solutions, architecture patterns, and engineering standards to support analytics, AI/ML, and operational use cases.
The ideal candidate will combine deep technical expertise with strong business alignment, enabling scalable, secure, and high-performing data platforms.
Solution architecture is critical to ensuring standardized, scalable, and governed data ecosystems across domains and use cases
Key Responsibilities
1. Architecture & Solution Design
- Define and implement end-to-end data architecture (ingestion to transformation to consumption)
- Design scalable Lakehouse architectures (Databricks, Delta Lake)
- Develop reference architectures, reusable frameworks, and design patterns
- Align architecture with performance, scalability, security, and cost optimization goals
2. Data Modeling & Domain Architecture
- Define canonical data models, dimensional schemas, and semantic layers
- Architect enterprise data across domains:
- Claims, Member, Provider, Eligibility
- Ensure data consistency, interoperability, and reuse across teams
3. Azure Databricks & Cloud Enablement
- Architect solutions using:
- Azure Databricks (Mandatory)
- Azure Data Services (ADF, ADLS, Synapse)
- Guide engineering teams on:
- Spark optimization, Delta Lake design, and data pipeline best practices
- Enable multi-cloud integrations when required
4. Governance, Security & Compliance
- Define and enforce:
- Data governance frameworks (lineage, quality, metadata)
- Access control, RBAC, and data security policies
- Ensure compliance with:
- HIPAA, HITRUST, and enterprise regulatory standards
- Establish data quality SLAs and auditability mechanisms
5. Engineering & Platform Alignment
- Work closely with:
- Data Engineering teams
- Platform Engineering teams
- AI/ML Engineering teams
- Provide architectural oversight for pipelines, workflows, and platform capabilities
- Drive standardization across CI/CD, DataOps, and MLOps practices
6. Stakeholder & Business Engagement
- Collaborate with business, product, and analytics teams to:
- Translate requirements into scalable technical solutions
- Lead architecture reviews, design approvals, and governance forums (ARB)
- Communicate architecture decisions and trade-offs to leadership
Required Skills
- Strong experience in:
- Azure Databricks (Mandatory) - PySpark, Delta Lake
- Cloud Architecture (Azure preferred)
- Deep expertise in:
- Data Architecture & Data Modeling (OLTP, OLAP, Dimensional)
- Lakehouse / Data Warehouse design patterns
- Hands-on experience with:
- ETL/ELT pipelines and orchestration frameworks
- CI/CD and DevOps practices (Azure DevOps, Git)
- Metadata, lineage, and governance tools (Unity Catalog, Purview)
Preferred Skills
- Experience with:
- AI/ML data architectures (feature stores, model pipelines)
- Multi-cloud environments (Azure + GCP/Snowflake)
- Strong understanding of:
- Medallion architecture (Bronze-Silver-Gold)
Domain Experience (Good to Have)
- US Healthcare ecosystem:
- Claims, Member, Provider datasets
- Familiarity with:
- FHIR / HL7 / EMR data models
- Payment Integrity / Risk Adjustment use cases
Pay:The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Fractal, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is: $150,000 - $170,000. In addition, you may be eligible for a discretionary bonus for the current performance period.
Benefits:As a full-time employee of the company or as an hourly employee working more than 30 hours per week, you will be eligible to participate in the health, dental, vision, life insurance, and disability plans in accordance with the plan documents, which may be amended from time to time. You will be eligible for benefits on the first day of employment with the Company. In addition, you are eligible to participate in the Company 401(k) Plan after 30 days of employment, in accordance with the applicable plan terms. The Company provides for 11 paid holidays and 12 weeks of Parental Leave. We also follow a "free time" PTO policy, allowing you the flexibility to take time needed for either sick time or vacation.
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
Hiring Related QueriesOutside India:
[email protected]This inbox does not process resume submissions. All applications must be made through posted job openings
Not the right fit? Let us know you're interested in a future opportunity by clicking Introduce Yourself in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!