Lead Data Engineer

MetaPhase Consulting

$110K — $140K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 7+ years of hands-on experience with database architecture and design, especially in Azure.
  • Certified Scrum Master (CSM) certification is required.
  • Experience with data modeling for both transactional and analytical data stores.
  • Proficient in data integration using Python and Azure Data Factory (ADF).
  • Skilled in report design and deployment with Microsoft Power BI.
  • Expertise in performance-tuning databases and clean coding techniques.
  • Demonstrated team leadership experience.

Responsibilities

  • Act as a servant leader and mentor to a high-performing data team.
  • Oversee workload prioritization and sprint planning for database tasks.
  • Maintain and enhance technical documentation for data models and integration.
  • Design and develop Azure SQL database scripts and integration routines.
  • Manage Azure Data Factory components supporting database operations.
  • Utilize Python and PowerShell for automation and data cleansing.
  • Review and provide feedback on database deployment plans.

Benefits

  • Remote work opportunity.
  • Support for professional development and certifications.
  • Collaborative environment with emphasis on mentoring.
  • Engagement with advanced technologies and tools.
  • Opportunities for leading enterprise-wide data initiatives.
Full Job Description
Role Summary

MetaPhase is seeking an experienced and strategic Data Engineer with 7+ years of experience to provide hands-on technical expertise with data architecture, data modeling, and data engineering tasks in an Azure environment. This role will provide both hands-on technical leadership and people management for a team of three data engineers supporting enterprise-wide data initiatives. In addition, the ideal candidate will lead database development work and help coordinate tasks with the web developers to ensure a robust integrated solution is built.

What You Will Be Doing
  • Act as a servant leader and mentor a lean high performing team of data professionals.
  • Manage workload prioritization, sprint planning, and delivery oversight for database related tasks.
  • Maintain and enhance data models (ERDs), Data Dictionaries (DD), Source-to-Target mappings (STM) and other data related documentation to sustain existing operations while building new analytical capabilities.
  • Design, develop and maintain scripts for Azure SQL database that create/modify database objects (tables, views, constraints, triggers) and data integration routines (ETL) that support change data capture.
  • Design, develop and maintain Azure Data Factory object and components, Elastic Job Agents and Azure Functions that support database activities.
  • Leverage Python and PowerShell as needed for automation and data cleaning.
  • Review database deployment plans for scheduled releases and provide feedback.
  • Peer review database code to provide feedback and coach team members.
  • Create and maintain other technical documentation relating to data architecture.
  • Troubleshoot or assist team members with troubleshooting data issues to identify root causes, propose recommendations, and implement solutions that will improve data availability, increase data quality, and optimize performance.
  • Coordinate and act as a liaison with other groups including OCIO, Azure DBAs and Engineers
  • Managing Power BI workspaces and on-premises MS data gateways

What We Need From You (Required)
  • A minimum of 7+ years of hands-on experience with database architecture, design, development, deployment, preferably in Azure environments.
  • Certified Scrum Master (CSM) certification required; candidates must possess an active CSM certification upon hire or obtain certification immediately following employment.
  • Data modeling experience with both transactional and analytical data stores.
  • Data integration experience with Python and Azure Data Factory (ADF), from design to implementation.
  • Report design, development, and deployment experience with Microsoft Power BI.
  • Expert in performance-tuning databases, SQL scripts, and clean coding techniques.
  • Team leadership experience.

What Sets You Apart (Preferred)
  • Consulting experience in a federal government environment.
  • Data architecture experience on an enterprise scale, integrating multiple systems with different methods to accommodate various data structures and access protocols.
  • Demonstrated proficiency through Microsoft Azure Data & AI certifications, including certifications such as DP-700, DP-300, AZ-305, DP-420, and/or DP-100.

Work Location

  • Client location: Remote.


Travel

  • N/A


Education Level

  • Bachelor's degree in data analytics engineering, computer science, or a related technical field required; a Master's degree is preferred.


Clearance Level

  • Ability to Obtain a Public Trust


  • U.S. Citizenship required (NO EXCEPTIONS)

Similar Jobs

More Jobs at MetaPhase Consulting

More Information Technology Jobs

Find similar Lead Data Engineer jobs: