Data Solutions Engineer - Hybrid/Durham,NC

PowerSecure$90K — $120K *
Enterprise Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 2+ years of hands-on data engineering or significant data-oriented software engineering experience.
  • 2+ years of experience building pipelines on Azure and Databricks or comparable platforms.
  • Strong SQL skills, including analytical queries and window functions, alongside fundamentals of data modeling.
  • Bachelor's degree in MIS, Computer Science, Engineering, or equivalent experience required.
  • Proficiency in SQL and Python (PySpark), with focus on performance tuning for large datasets.
  • Familiarity with Azure tools such as Data Factory, Databricks, Delta Lake, and Azure DevOps.

Responsibilities

  • Design, implement, and support end-to-end ELT data pipelines using Databricks and Azure Data Factory.
  • Implement data quality checks based on Delta Live Tables expectations and create alerting mechanisms.
  • Build analytics-ready Delta tables through dimensional modeling for BI developers.
  • Manage schema deviations and implement change data capture and deletion-flag patterns.
  • Operationalize jobs with a focus on monitoring, logging, and participate in on-call duty.
  • Collaborate with the Data Architect on design standards for governance and security.
  • Document data processes, contracts, and performance metrics to enhance reliability.

Benefits

  • Remote work flexibility with occasional travel for training or meetings.
  • Ability to accommodate flexible working hours across different time zones.
  • Opportunity for after-hours tasks, enhancing adaptability in job role.
Full Job Description
Job Summary:

The Data Engineer designs, builds, and operates reliable, scalable data pipelines on PowerSecure's Azure data platform to enable trusted analytics and self-service BI. This role partners with BI Developers, the Data Architect, and business stakeholders to ingest, model, and deliver high-quality data using Azure Data Factory, Databricks (PySpark/Spark SQL), and Delta Lake (including Delta Live Tables). Responsibilities include batch/stream ingestion, data transformation (ELT), orchestration, data quality enforcement, and operational support.

Minimum Qualifications: (Education, Experience, Knowledge, and Skills):
  • 2+ years of hands-on data engineering (or comparable software engineering with significant
    data work)
  • 2+ years building pipelines on Azure and Databricks (or equivalent cloud + Spark)
  • Strong SQL (analytical queries, window functions), PySpark/Spark SQL, and data modeling fundamentals
  • Bachelor's degree in MIS, Computer Science, Engineering, or equivalent experience
  • Proficiency with SQL and Python (PySpark), including performance tuning on large datasets
  • Experience with Azure Databricks, Delta Lake, Delta Live Tables (DLT), Azure Data Factory (or Fabric Data Pipelines), ADLS Gen2, and Azure DevOps/Git for CI/CD
  • Working knowledge of Unity Catalog and/or Microsoft Purview for governance, lineage, and security
  • Familiarity with data ingestion patterns (files, APIs, JDBC), schema evolution, CDC, and deletion detection patterns
  • Understanding of dimensional modeling to produce analytics-ready datasets for Power BI
  • Exposure to orchestration/monitoring, cost optimization, alerting, and runbook-driven operations
  • Data pipeline design (batch & streaming), DLT expectations for data quality, and robust error handling
  • Source control, branching strategies, and CI/CD for data assets (notebooks, jobs, workflows)
  • Practical understanding of privacy, security, and RBAC in cloud data platforms
  • Excellent communication, documentation, and cross-functional collaboration skills
  • Analytical mindset; bias toward automation and measurable reliability
  • Applicants must be legally authorized to work in the United States and should not require now, or in the future, sponsorship for employment visa sponsorship.

Job Duties and Responsibilities:
  • Design, implement, and support end-to-end ELT pipelines (ingest 14 transform 14 publish) in Databricks/ADF
  • Implement data quality checks (DLT expectations, unit tests) with alerting and remediation runbooks
  • Build curated, analytics-ready Delta tables using dimensional modeling for consumption by BI Developers
  • Implement CDC and deletion-flag patterns; manage schema drift and partitioning/Z-Ordering strategies
  • Operationalize jobs with monitoring, logging, alerting; participate in an on-call rotation as needed
  • Partner with the Data Architect to align designs with standards for governance, security, and cost efficiency
  • Document pipelines, data contracts, and SLAs; continuously improve performance and reliability

Working Conditions:
  • This position is remote
  • Occasional,travel may be required for training or meetings.
  • Must be able to work flexible hours to accommodate different time zones (Central/Eastern/Mountain/Pacific), if necessary.
  • Be flexible for after-hours tasks, as needed.

The above statements are intended to describe the general nature and level of work being performed
by individuals assigned to this position. They are not intended to be an exhaustive list of all
responsibilities, duties, and skills required. Management reserves the right to assign or reassign
duties and responsibilities at any time, based on business needs.

About PowerSecure

PowerSecure Careers

Joining PowerSecure offers a unique opportunity to be part of a dynamic team that leads in providing innovative energy solutions. This is an ideal time to engage with a company that values growth, leadership, and professional development.

Explore Job Opportunities

PowerSecure seeks talented individuals to contribute to and benefit from the company's commitment to industry leadership and innovation. Explore a range of job opportunities that can propel a career to new heights in an environment that fosters diversity and inclusion.

Experience Professional Growth

At PowerSecure, career growth is not just a possibility—it is a priority. With a variety of professional development and diversity training programs, employees are equipped to excel in their roles and beyond. The company supports career advancement through robust training, mentorship, and access to cutting-edge projects.

Engage in Meaningful Work

PowerSecure is dedicated to transforming the energy sector through innovative solutions. Employees at PowerSecure take on challenging projects that drive significant change and have a positive impact on communities and the environment.

Join a Diverse and Inclusive Team

The culture at PowerSecure is built on a foundation of respect and inclusion, where diverse perspectives are valued and contribute to the company's success. The team at PowerSecure is composed of dedicated professionals from various backgrounds, all working together to achieve common goals.

Internship Opportunities

For those starting their career journey, PowerSecure offers internship programs that provide hands-on experience and a chance to develop essential skills in the energy sector. Internships at PowerSecure are a gateway to full-time employment and a successful career in the industry.

Benefits and Employee Well-being

PowerSecure is committed to the well-being of its team members, offering comprehensive benefits designed to support both personal and professional life. Benefits include health, dental, and vision insurance, as well as wellness programs that promote a balanced lifestyle.

Networking and Leadership Opportunities

Employees are encouraged to engage in networking events and leadership training to enhance their skills and advance their careers. PowerSecure fosters an environment where taking initiative and leading innovation are part of daily life.

Apply Today

Discover the positions available at PowerSecure that match your skills and interests. PowerSecure is actively hiring and looking for individuals who are passionate, curious, and driven to excel in their professional fields.

Stay Connected with PowerSecure Careers

Keep up to date with the latest news, career tips, and job openings at PowerSecure. Subscribe to receive personalized job alerts and insider information that can help you navigate your career path effectively.

Explore PowerSecure Jobs

Whether looking for an internship, entry-level, or executive position, PowerSecure offers a range of opportunities to join a leading team in the energy sector. Start your journey today by exploring the positions available and submitting your resume for consideration.
Learn more about PowerSecure

Similar Jobs

More Jobs at PowerSecure

More Enterprise Technology Jobs

Find similar Data Solutions Engineer - Hybrid/Durham,NC jobs: