Job DescriptionSummaryBuilds and runs CLEAResult's Databricks data platform. The work covers source ingestion, governed silver and gold layers, analytics data products, and AI-assisted pipelines.
Responsibilities- Build and maintain Databricks Asset Bundles (ingestion, transform, product and orchestration jobs) following the team's bundle standards and CI/CD (dev and prod via GitHub Actions and service principals).
- Run Salesforce (Lakeflow Connect) ingestion across client orgs, including sandbox re-auth and field-level-security column-loss issues, without breaking PII-tagged silver tables.
- Enforce data governance: Unity Catalog grants, PII tagging and ABAC masking, table-level access for sensitive intermediate data.
- Build document-processing and retrieval pipelines that use foundation-model endpoints for classification, detection and inference.
- Build reporting marts and data products that support business KPIs and stakeholder reporting.
- Evaluate and choose LLM serving endpoints (model bake-offs, deprecation migrations).
- Debug failing pipelines and jobs, and document known defects and runbooks for the team.
Qualifications- 3+ years in data engineering, with hands-on production experience on Databricks.
- Strong Python, SQL and PySpark; experience with Delta Lake and Delta Live Tables/Lakeflow.
- Experience with Unity Catalog governance: grants, tagging, column masking and row filters.
- Experience deploying data infrastructure as code (Databricks Asset Bundles, Terraform or similar) with Git-based CI/CD.
- Familiar with Salesforce data models and CRM ingestion patterns.
- Experience building or integrating LLM workflows (prompting, retrieval/RAG, model evaluation) is a strong plus.
- Working knowledge of Azure (identity, service principals, storage).
- Bachelor's degree in computer science, engineering or a related field, or equivalent experience.
- Clear communicator who documents well and works with both technical and business stakeholders.
DOT RequirementsIf applicable, meet all DOT qualification requirements and comply with all applicable federal, state, and local transportation regulations.
Compensation Range$141,900.00 - $212,900.00
CurrencyUSD
TypeSalary
Any offered salary is determined based on internal equity, internal salary ranges, market data/ranges, applicant's skills and prior relevant experience, certain degrees and certifications (e.g. JD/technology), for example.
CLEAResult will not provide sponsorship or support for immigration status or work authorization including for international students. Applicants must be authorized to work in the country where the position is located without the need for employer sponsorship or support. Successful hires must pass pre-employment checks.
The above job description and job requirements are not intended to be all inclusive. CLEAResult retains the right to make changes or adjustments to job descriptions and/or requirements at any time without notice.
