Hands-on experience with Databricks cluster/job configuration and SQL warehouse policies.
Proficient in SCIM/REST for identity and access management.
Knowledge of platform monitoring tools and Lakehouse Monitoring.
Experience in conducting access and sharing policy audits.
Skilled in applying tags for data and resources in Databricks.
Experience managing Databricks workspaces, clusters, and jobs.
Proficient in managing user accounts and service principals.
Responsibilities
Architect and develop high-performance data ingestion and transformation pipelines.
Optimize and maintain analytical pipelines within Databricks Lakehouse environments.
Collaborate with federal technical teams and cross-functional personnel.
Conduct audits on access and sharing policies for data assets.
Enforce data and resource tagging policies consistently across platforms.
Benefits
Opportunity to work on digital transformation projects for government clients.
Collaborative work environment with federal technical teams.
Potential for professional growth in cloud-based data platform administration.
Full Job Description
Position Overview
SiloSmashers is hiring for a Databricks Platform Administrator to support digital transformation efforts for a government customer. The selected candidate will serve as part of a team responsible for architecting, developing, optimizing, and maintaining high-performance data ingestion, transformation, streaming, and analytical pipelines within Databricks-enabled Lakehouse environments. This role is expected to collaborate closely with the federal technical teams, and cross-task platform, SRE, governance, privacy, and development personnel.
Required Skills
Hands-on experience configuring and implementing cluster/job, pipeline, and SQL warehouse policies; experience working with secret scopes;
Experience implementing SCIM/REST for identity and access management;
Working knowledge of platform monitoring and observability tools and (e.g. Unity Catalog system tables, platform usage/DBU consumption, auditing user/group/service principal access and activity, Lakehouse Monitoring).
Experience conducting access and sharing policy audits; validating user, group, and data-asset permissions against data-owner/steward-defined policies and ensuring enforcement is applied consistently within and among enterprise platforms.
Experience applying and enforcing tags for data and resources such as compute (SQL warehouses, classic compute, serverless compute, etc.), jobs, pipelines, and Databricks Apps.
Five (5) or more years of recent experience administering cloud-based data platforms, including workspace configuration, identity/access management, and compute governance in Databricks, AWS, Azure, or equivalent environments.
Bachelor's degree in computer science, information systems, engineering, or a related field; or five (5) or more years of equivalent experience in lieu of a degree.
This position requires regular, physical attendance at customer sites.
About SiloSmashers
SiloSmashers is an information technology services company that provides consulting, technology, and business process services to government and commercial clients. The company was founded in 1992 and is headquartered in McLean, Virginia. SiloSmashers offers a range of services, including enterprise architecture, data management, and software development. The company has worked with clients in a variety of industries, including healthcare, finance, and defense.
