Data Engineer

San Diego Community Power

$84K — $110K *
Energy & Utilities
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 2-3 years of experience as a Data Engineer, preferably in the energy industry.
  • Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.
  • Advanced working knowledge of SQL and relational databases.
  • Proficient in big data tools like Hadoop and Spark.
  • Strong analytic skills with unstructured datasets.

Responsibilities

  • Build and maintain a centralized cloud-based data infrastructure.
  • Assemble complex data sets to meet business requirements.
  • Develop data tools and APIs for analysis.
  • Deploy and monitor machine learning algorithms in production.
  • Ensure data accessibility, security, and compliance with policies.
  • Improve data systems speed and reliability.
  • Collaborate with teams to optimize data usage across the organization.

Benefits

  • Group health benefits including medical, vision, and dental insurance.
  • $100,000 Life & AD&D policy along with STD and LTD coverage.
  • 457(b) retirement plan with a 10% contribution from SDCP.
  • 11 holidays plus a paid winter holiday and 160 hours of paid time off annually.
  • 96 hours of paid sick leave per year.
Full Job Description


OPEN POSITION ANNOUNCEMENT!

Data Engineer

Open until filled.

Posted 4/29/2026 San Diego County - hybrid work schedule set by SDCP

About the role: The San Diego Community Power (SDCP) is seeking a seasoned Data Engineer to join our growing team of analytics experts who will be responsible for designing, maintaining, expanding, and optimizing our data infrastructure for data collection, management, transformation, and access. A key priority of this role will be to assist in SDCP's development of centralizing its data eco-system to allow for creation of pipelines that convert raw data into usable formats for data analysts and other data consumers to utilize. The Data Engineer will handle the core data aspects of software engineering and data science and utilize software engineering principles to develop algorithms that automate the data flow process. They will collaborate with data and system analysts to build machine learning and analytics infrastructure from testing to deployment.

ESSENTIAL DUTIES AND PRIMARY RESPONSIBILITES
  • Building and maintaining a centralized cloud-based data infrastructure for optimal extraction, transformation, and loading of data from a wide variety of sources.
  • Assemble large, complex data sets that meet functional/non-functional business requirements.
  • Developing data tools and APIs for data analysis.
  • Deploying and monitoring machine learning algorithms and statistical methods in production environments to solve organizational needs.
  • Ensuring data accessibility and security and implementing company data policies regarding data privacy and confidentiality.
  • Improving data systems reliability, speed, and performance.
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer trends, operational efficiency, and other key business performance metrics.
  • Collaborating with other internal teams, data analysts, and other stakeholders to understand and optimize how data can be leveraged to meet business needs.
  • Assist in drafting data and analytics' solicitations and in the selection of consultants.
  • Assist with drafting staff reports and presentations for Board and Committee meetings.
  • Performs other related duties and responsibilities as required.


MINIMUM KNOWLEDGE, SKILLS, AND ABILITES
  • Advance working knowledge of SQL, experience working with relational databases, query authoring (SQL) and working familiarity with various databases.
  • Demonstrated experience in developing API and integrations to support analytics in cloud environment.
  • Experience building and optimizing 'big data' data pipelines, architectures, and data sets.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Strong analytic skills related to working with unstructured datasets.
  • Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
  • A successful history of manipulating, processing, and extracting value from large, disconnected datasets.
  • Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
  • Good understanding of data architecture, data design, data warehousing and data modeling concepts.
  • Strong project management and organizational skills.
  • Experience supporting and working with cross-functional teams in a dynamic environment.

PREFERRED KNOWLEDGE, SKILLS, AND ABILITES
  • Experience in the energy sector and/or supporting the implementation of programs funded by California state agencies (e.g., California Public Utilities Commission, California Energy Commission, California Air Resources Board).
  • Ability to strongly represent the organization in various professional engagement settings from local to national convenings (conferences, workshops, executive meetings, etc.).


PREFERRED QUALIFICATIONS, EDUCATION AND EXPERIENCE

Minimum of two (2) to three (3) years of professional experience in a Data Engineer role, preferably in the energy industry with a graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. The candidate should also have experience using the following software/tools:
  • Experience with big data tools: Hadoop, Spark, PowerBI, Kafka, etc.
  • Experience with AWS, Azure and Google Cloud services.
  • Experience with relational SQL and NoSQL databases.
  • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
  • Experience with open-source technologies: Python, Pytorch, Flask, Tensorflow or Keras
  • Experience with stream-processing systems: Storm, Spark-Streaming, etc.
  • Experience with object-oriented/object function scripting languages: Java, C++ etc.
  • Experience with batch, micro-batching and real-time data ingestion methodologies.
  • Experience with GitHub or similar code repositories


WORK ENVIROMENT & CONDITIONS

Prolonged periods sitting at a desk and working on a computer. The position requires occasional carrying, lifting and/or moving objects up to 25 pounds. Occasional local travel required and reliable transportation to be able to attend SDCP events, meetings, and workshops as needed is expected. At SDCP we work in the communities we serve and in the office. SDCP works to ensure a safe and healthy workplace for employees and in our communities. SDCP requires employees to be fully vaccinated for COVID-19. SDCP is an agency required to adopt and promulgate a Conflict-of-Interest Code ("COI"). The COI code requires employees in designated positions, including those identified under the interim disclosure process to file a Statement of Economic Interests (Form 700) on an annual basis. A Successful candidate accepting this position may be required to file Conflict of Interest forms subject to the regulations of the Fair Political Practices Commission.

COMPENSATION:

Salary Range: The position salary range is: $84,900 - $110,400; with exact compensation to be determined by SDCP, depending upon experience.

Benefits: Standard benefits package including but not limited to:

Insurance: SDCP offers group health benefits, including medical, vision, and dental insurance, for eligible FT employees. Also provided is a $100,000 Life & AD&D policy, STD and LTD coverage that is 100% paid by SDCP.

Retirement: SDCP offers a 457(b) plan for employee contributions and contributes 10% of eligible compensation to the employee's Money Purchase Plan.

Paid Time Off: 11 holidays per year + paid winter holiday (between 12/24-12/31), 160 hours of accrued paid time off per year (increases with time in service), and 96 hours per year of accrued paid sick leave.

This job description may not be inclusive of all assigned duties, responsibilities, or aspects of the job described, and may be amended at the discretion of SDCP as needed.

California Pay Range

$84,900-$110,400 USD

Similar Jobs

More Jobs at San Diego Community Power

More Energy & Utilities Jobs

Find similar Data Engineer jobs: