8+ years of experience administering cloud-based data platforms, with 5 years in the last 8 years specifically in Databricks, AWS, Azure, or similar environments.
Bachelor's degree in computer science, information systems, engineering, or related field, or 5+ years of equivalent experience.
Ability to obtain and maintain a Public Trust clearance.
Hands-on experience with cluster/job configuration, pipeline management, and SQL warehouse policies.
Responsibilities
Architect and develop high-performance data ingestion and transformation pipelines.
Optimize and maintain Databricks-enabled Lakehouse environments.
Collaborate with federal technical teams and cross-functional personnel.
Conduct access and sharing policy audits to ensure compliance with data governance.
Manage user accounts, service principals, and groups within the platform.
Benefits
Opportunity to work on digital transformation efforts for a government customer.
Engagement with cross-functional teams, enhancing collaboration skills.
Regular physical attendance at customer sites, fostering direct client relationships.
Full Job Description
Databricks Platform Administrator to support digital transformation efforts for a government customer. The selected candidate will serve as part of a team responsible for architecting, developing, optimizing, and maintaining high-performance data ingestion, transformation, streaming, and analytical pipelines within Databricks-enabled Lakehouse environments. This role is expected to collaborate closely with the federal technical teams, and cross-task platform, SRE, governance, privacy, and development personnel.
Hands-on experience configuring and implementing cluster/job, pipeline, and SQL warehouse policies; experience working with secret scopes;
Experience implementing SCIM/REST for identity and access management;
Working knowledge of platform monitoring and observability tools and (e.g. Unity Catalog system tables, platform usage/DBU consumption, auditing user/group/service principal access and activity, Lakehouse Monitoring).
Experience conducting access and sharing policy audits; validating user, group, and data-asset permissions against data-owner/steward-defined policies and ensuring enforcement is applied consistently within and among enterprise platforms.
Experience applying and enforcing tags for data and resources such as compute (SQL warehouses, classic compute, serverless compute, etc.), jobs, pipelines, and Databricks Apps.
Eight (8) or more years of experience (5 of which must be within the last 8 years) administering cloud-based data platforms, including workspace configuration, identity/access management, and compute governance in Databricks, AWS, Azure, or equivalent environments.
Bachelor's degree in computer science, information systems, engineering, or a related field; or five (5) or more years of equivalent experience in lieu of a degree.
This position requires regular, physical attendance at customer sites.
About SiloSmashers
SiloSmashers is an information technology services company that provides consulting, technology, and business process services to government and commercial clients. The company was founded in 1992 and is headquartered in McLean, Virginia. SiloSmashers offers a range of services, including enterprise architecture, data management, and software development. The company has worked with clients in a variety of industries, including healthcare, finance, and defense.
