Full Job Description
As a Lead Data Engineer joining Logic20/20's AI & Analytics practice, you'll help clients scale their data solutions and make data-driven decisions while driving enterprise-level innovation.
You'll work closely with the client to understand their business processes and analytics needs to design and build data pipelines and cloud data solutions. You will have the opportunity to guide your client through best practices in data lake, data processing, and data pipeline design to help them achieve their business goals.
You will work closely with your team, including analysts, architects, and technical project managers, to design solutions and work together to deliver a world-class solution.
You'll strike a balance of technical skills and business acumen to help clients better understand their core needs and what is possible for a future state.
What you'll do:
• Lead end-to-end design and development of data pipelines, notebooks, lakehouses, and warehouses in Microsoft Fabric
• Orchestrate and implement scalable ETL/ELT pipelines integrating structured and unstructured data from multiple sources
• Define and enforce data engineering best practices: data modeling, partitioning, performance tuning, data quality
• Own the CI/CD strategy for Fabric artifacts: Azure DevOps integration, deployment pipelines, environment promotion (dev/test/prod), automated test scripts validating deployments
• Translate business requirements into technical designs, working closely with architects and analysts
• Mentor a team of data engineers, conduct code reviews, enforce coding/security standards
• Monitor and optimize pipeline performance, cost, and capacity utilization
• Track the Fabric roadmap and evaluate new features for adoption
Qualifications
Required:
• 10-15 years of cloud data engineering experience, including hands-on experience with Microsoft Fabric.
• 2+ years of experience leading technical delivery teams.
• Deep expertise in Microsoft Fabric components including Lakehouse, Warehouse, Data Factory, Notebooks (PySpark/Spark SQL), and Power BI integration.
• Advanced proficiency in Python, SQL, Spark/PySpark, data warehousing, dimensional modeling, and modern enterprise data platform architectures.
• Experience designing, building, and migrating cloud-based data platforms using Azure Data Factory, Synapse Pipelines, and related Azure technologies.
• Hands-on experience with CI/CD, DataOps, Git-based development, deployment automation, and Infrastructure as Code (Azure DevOps, GitHub Actions, Bicep, ARM, or Terraform).
• Strong understanding of data governance, security, RBAC, automated testing, and data quality validation frameworks.
• Excellent consulting, communication, and client-facing leadership skills with the ability to drive technical decisions, mentor engineers, and partner effectively with architects, project managers, and business stakeholders.
Preferred:
• An undergraduate degree in technology or business.
• Microsoft Certifications (Fabric Data Engineer, Azure Fundamentals, Azure Data Engineer Associate, etc.).
Additional Information
At Logic20/20, we believe in recognizing and rewarding exceptional talent. Logic20/20 offers a competitive compensation package, with a target base salary range of $173,077 - $179,863 for this role. The final base salary offered is dependent on factors such as relevant experience, skills, qualifications, and location. Eligible employees may also qualify for performance-based bonuses and other incentives.