City and County of San Francisco

Principal Data Engineer (1044) - Data Enablement - DataSF

City and County of San Francisco$130K — $160K *
Education, Government & Non-Profit
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Associate degree in computer science or related field, or equivalent experience.
  • Five years of experience with system components or platforms.
  • Experience in data engineering or on a data platform required.
  • Strong hands-on background in building and operating data pipelines and governance.
  • Analytics engineering experience in dbt or similar tools preferred.

Responsibilities

  • Lead the full department engagement lifecycle from initial conversations to ongoing support.
  • Define a clear DataSF service catalog to guide departmental interactions and expectations.
  • Work with departments to model their data needs into actionable requirements.
  • Shape and enhance the analytics engineering practice with best practices and standards.
  • Develop self-service pathways for data discovery and access requests.
  • Establish and maintain data quality and trust standards.
  • Integrate governance and readiness into the onboarding process.

Benefits

  • Opportunities for professional development and training.
  • Potential for career growth, including team management.
  • Ability to make a tangible impact on public sector data practices.
  • Collaborative work environment with cross-departmental engagement.
  • Commitment to equity and ethical data use.
Full Job Description
Specific information regarding this recruitment process are listed below:
  • Application Opening: Tuesday, August 25, 2026
  • Application Deadline: Tuesday, September 15, 2026 at 11:59pm PST
  • Required Supplemental Questionnaire due at the time of application:https://forms.cloud.microsoft/g/DKNY1GxmqE

Job Description

As DataSF grows to support every city department and their diverse needs, we're formalizing the data practice that sits around the platform-clear service offerings, consistent onboarding, intuitive self-service tools, and reliable data quality standards. This role is the principal engineer leading that effort. You'll own the department-facing experience: how teams learn to work with DataSF, what they can expect from our services, and how projects are defined and delivered. You'll combine strong platform and data engineering depth with the ability to translate departmental needs into actionable, scalable solutions. Starting as an individual contributor partnering closely with two analytics engineers, the role may evolve to manage a small team as our practice grows.

Examples of Important and Essential Duties:
  • Own the full department engagement lifecycle-from initial conversation through scoping, onboarding, delivery, and ongoing support.
  • Define and publish the DataSF service catalog, clearly outlining what constitutes standard queue work, what requires a scoped project, and what triggers an interagency agreement, using measurable criteria.
  • Partner directly with departments to understand and model their data domains, translating those needs into actionable requirements the platform can serve.
  • Shape the analytics engineering practice, including dbt models, department pipelines, data quality approaches, and reusable standards the team relies on.
  • Build self-service pathways that allow departments to discover data, assess its trustworthiness, and request access without needing to know whom to contact.
  • Own data quality standards and trust signals-freshness, completeness, lineage-so users understand what assumptions they can make about each dataset.
  • Integrate governance and data-readiness requirements into the onboarding process rather than treating them as afterthoughts.
  • Set and maintain clear scope expectations with departments and perform related duties as assigned.


Qualifications

Education:

An associate degree in computer science, computer engineering, information systems, or a closely related field from an accredited college or university OR its equivalent in terms of total course credits/units [i.e., at least sixty (60) semester or ninety (90) quarter credits/units with a minimum of twenty (20) semester or thirty (30) quarter credits/units in one of the fields above or a closely-related field].

Experience:

Five (5) years of experience analyzing, installing, configuring, enhancing, and/or maintaining the components of a system or platform.

Substitution:

One year of additional experience as described above may be substituted for the required degree.

Completion of the 1010 Information Systems Trainee Program may be substituted for the required degree.

Note(s):
  • One-year full-time employment is considered equivalent to 2000 hours (2000 hours of qualifying work experience is based on a 40 hour work week). Any overtime hours that you work above forty (40) hours per week are not included in the calculation to determine full-time employment.
  • Applicants must meet minimum qualification requirements by the final filing date unless otherwise noted.

Desirable Qualifications: The stated desirable qualifications may be used to identify job finalists at the end of the selection process when candidates are referred for hiring.
  • Technical:
    • Strong hands-on data platform or data engineering background: building and operating pipelines, data modeling, transformation frameworks, and platform governance.
    • Analytics engineering depth in dbt, semantic modeling, or comparable.
    • Cloud data warehouse experience (Snowflake preferred) and advanced SQL.
    • Data governance, privacy, or security awareness, including handling of sensitive data.
  • Stakeholder & enablement:
    • Demonstrated strength working directly with non-technical stakeholders to understand their needs, translating them into technical work, and driving adoption.
    • Experience getting people to actually use a platform, not just building one: onboarding, enablement, training, or change management.
    • Comfort setting expectations and holding boundaries with demanding stakeholders while maintaining the relationship.
    • Experience mentoring engineers or analysts and raising the standard of a team's work.
  • Mission alignment:
    • Genuine interest in public-sector impact and a clear-eyed understanding of what working in government is like.
    • Commitment to equity, transparency, and ethical data use in service of San Francisco's residents.
    • Every application is reviewed to ensure that you meet the minimum qualifications as listed in the job ad. Please review our articles on Employment Application and Minimum Qualifications and Verification of Experience and/or Education for considerations taken when reviewing applications.

Verification:
Please make sure it is clear in your application exactly how you meet the minimum qualifications. Every application is reviewed to ensure that you meet the minimum qualifications as listed in the job ad. Please review our articles on Employment Application and Minimum Qualifications and Verification of Experience and/or Education for considerations taken when reviewing applications. Applicants may be required to submit verification of qualifying education and experience at any point in the application and/or departmental selection process.

Additional Information

Selection Procedures

The selection process will include evaluation of applications in relation to minimum requirements. Depending on the number of applicants, the Department may establish and implement additional screening mechanisms to comparatively evaluation qualifications of candidates. If this becomes necessary, only those applicants whose qualifications most closely meet the needs of the Department will be invited for an interview.

Applicants who meet the minimum qualifications are not guaranteed to advance through all of the steps in the selection process.

Supplemental Questionnaire

All candidates must complete a supplemental questionnaire as part of the employment application. Please see this link to submit the supplemental questionnaire:

https://forms.cloud.microsoft/g/DKNY1GxmqE

About City and County of San Francisco

The City and County of San Francisco is a consolidated city-county government in the state of California. The government was established in 1850 and is responsible for providing a wide range of services to the residents of San Francisco, including public safety, transportation, housing, and social services. The government is led by a mayor and a board of supervisors, who are responsible for setting policy and overseeing the various departments and agencies that make up the government. San Francisco is known for its progressive policies and has been a leader in areas such as environmental protection, LGBTQ rights, and healthcare.
Learn more about City and County of San Francisco
Size
38,000 employees
Industry
Founded
1976

Similar Jobs

More Jobs at City and County of San Francisco

More Education, Government & Non-Profit Jobs

Find similar Principal Data Engineer (1044) - Data Enablement - DataSF jobs: