City and County of San Francisco

Principal Data Engineer (1044) - Data Enablement - DataSF

City and County of San Francisco$130K — $155K *
Education, Government & Non-Profit
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Associate degree in computer science, computer engineering, information systems, or related field, or equivalent experience.
  • Five years of experience in system or platform analysis, installation, configuration, and maintenance.
  • Strong hands-on experience in data platforms and engineering, including building pipelines and data modeling.
  • Proficiency in dbt, cloud data warehousing (Snowflake preferred), and advanced SQL.
  • Familiarity with data governance, privacy, and security considerations in handling sensitive data.

Responsibilities

  • Own the entire department engagement lifecycle from initial discussions to ongoing support.
  • Define and publish a clear DataSF service catalog outlining project types and requirements.
  • Collaborate with departments to model their data needs and translate them into actionable requirements.
  • Shape the analytics engineering practice including data quality approaches and reusable standards.
  • Develop self-service pathways for departments to access and request data securely.
  • Set and maintain scope expectations with departments, integrating them into the onboarding process.

Benefits

  • Opportunity to shape the data practice within a growing organization.
  • Flexibility for professional development and growth within an evolving role.
  • Engagement in impactful work within the public sector, contributing to community needs.
  • Potential to transition from an individual contributor to a management position as the team grows.
Full Job Description
Job Description

As DataSF grows to support every city department and their diverse needs, we're formalizing the data practice that sits around the platform-clear service offerings, consistent onboarding, intuitive self-service tools, and reliable data quality standards. This role is the principal engineer leading that effort. You'll own the department-facing experience: how teams learn to work with DataSF, what they can expect from our services, and how projects are defined and delivered. You'll combine strong platform and data engineering depth with the ability to translate departmental needs into actionable, scalable solutions. Starting as an individual contributor partnering closely with two analytics engineers, the role may evolve to manage a small team as our practice grows.

Examples of Important and Essential Duties:
  • Own the full department engagement lifecycle-from initial conversation through scoping, onboarding, delivery, and ongoing support.
  • Define and publish the DataSF service catalog, clearly outlining what constitutes standard queue work, what requires a scoped project, and what triggers an interagency agreement, using measurable criteria.
  • Partner directly with departments to understand and model their data domains, translating those needs into actionable requirements the platform can serve.
  • Shape the analytics engineering practice, including dbt models, department pipelines, data quality approaches, and reusable standards the team relies on.
  • Build self-service pathways that allow departments to discover data, assess its trustworthiness, and request access without needing to know whom to contact.
  • Own data quality standards and trust signals-freshness, completeness, lineage-so users understand what assumptions they can make about each dataset.
  • Integrate governance and data-readiness requirements into the onboarding process rather than treating them as afterthoughts.
  • Set and maintain clear scope expectations with departments and perform related duties as assigned.


Qualifications

Education:

An associate degree in computer science, computer engineering, information systems, or a closely related field from an accredited college or university OR its equivalent in terms of total course credits/units [i.e., at least sixty (60) semester or ninety (90) quarter credits/units with a minimum of twenty (20) semester or thirty (30) quarter credits/units in one of the fields above or a closely-related field].

Experience:

Five (5) years of experience analyzing, installing, configuring, enhancing, and/or maintaining the components of a system or platform.

Substitution:

One year of additional experience as described above may be substituted for the required degree.

Completion of the 1010 Information Systems Trainee Program may be substituted for the required degree.

Note(s):
  • One-year full-time employment is considered equivalent to 2000 hours (2000 hours of qualifying work experience is based on a 40 hour work week). Any overtime hours that you work above forty (40) hours per week are not included in the calculation to determine full-time employment.
  • Applicants must meet minimum qualification requirements by the final filing date unless otherwise noted.

Desirable Qualifications: The stated desirable qualifications may be used to identify job finalists at the end of the selection process when candidates are referred for hiring.
  • Technical:
    • Strong hands-on data platform or data engineering background: building and operating pipelines, data modeling, transformation frameworks, and platform governance.
    • Analytics engineering depth in dbt, semantic modeling, or comparable.
    • Cloud data warehouse experience (Snowflake preferred) and advanced SQL.
    • Data governance, privacy, or security awareness, including handling of sensitive data.
  • Stakeholder & enablement:
    • Demonstrated strength working directly with non-technical stakeholders to understand their needs, translating them into technical work, and driving adoption.
    • Experience getting people to actually use a platform, not just building one: onboarding, enablement, training, or change management.
    • Comfort setting expectations and holding boundaries with demanding stakeholders while maintaining the relationship.
    • Experience mentoring engineers or analysts and raising the standard of a team's work.
  • Mission alignment:
    • Genuine interest in public-sector impact and a clear-eyed understanding of what working in government is like.
    • Commitment to equity, transparency, and ethical data use in service of San Francisco's residents.
    • Every application is reviewed to ensure that you meet the minimum qualifications as listed in the job ad. Please review our articles on Employment Application and Minimum Qualifications and Verification of Experience and/or Education for considerations taken when reviewing applications.

Verification:
Please make sure it is clear in your application exactly how you meet the minimum qualifications. Every application is reviewed to ensure that you meet the minimum qualifications as listed in the job ad. Please review our articles on Employment Application and Minimum Qualifications and Verification of Experience and/or Education for considerations taken when reviewing applications. Applicants may be required to submit verification of qualifying education and experience at any point in the application and/or departmental selection process.

Additional Information

Selection Procedures

The selection process will include evaluation of applications in relation to minimum requirements. Depending on the number of applicants, the Department may establish and implement additional screening mechanisms to comparatively evaluation qualifications of candidates. If this becomes necessary, only those applicants whose qualifications most closely meet the needs of the Department will be invited for an interview.

Applicants who meet the minimum qualifications are not guaranteed to advance through all of the steps in the selection process.

Supplemental Questionnaire

All candidates must complete a supplemental questionnaire as part of the employment application. Please see this link to submit the supplemental questionnaire:

https://forms.cloud.microsoft/g/DKNY1GxmqE

About City and County of San Francisco

The City and County of San Francisco is a consolidated city-county government in the state of California. The government was established in 1850 and is responsible for providing a wide range of services to the residents of San Francisco, including public safety, transportation, housing, and social services. The government is led by a mayor and a board of supervisors, who are responsible for setting policy and overseeing the various departments and agencies that make up the government. San Francisco is known for its progressive policies and has been a leader in areas such as environmental protection, LGBTQ rights, and healthcare.
Learn more about City and County of San Francisco
Size
38,000 employees
Industry
Founded
1976

Similar Jobs

More Jobs at City and County of San Francisco

More Education, Government & Non-Profit Jobs

Find similar Principal Data Engineer (1044) - Data Enablement - DataSF jobs: