Brillio

Principal Data Engineer - R01558819

Brillio • $120K — $150K *
Dallas, TX 75217In-Person
Enterprise Technology
5 - 7 years of experience
Today
Be an Early Applicant
Job Overview by Ladders

Qualifications

  • 7+ years of experience in data engineering with a focus on Microsoft Fabric technologies.
  • Proficiency in SQL, Python, Scala, and R for data manipulation.
  • Experience in data pipeline development and ETL processes.
  • Strong understanding of data governance and security practices.
  • Ability to effectively lead and mentor a team.

Responsibilities

  • Design, develop, and deploy data pipelines within Microsoft Fabric using OneLake and Data Factory.
  • Architect and implement optimized ETL workflows for Fabric's unified data platform.
  • Build and manage integration solutions for structured and unstructured data in OneLake.
  • Leverage OneLake and integrate with Synapse for enterprise-scale analytics.
  • Collaborate with Data Scientists, Analysts, and BI Engineers to support advanced analytics.
  • Monitor and optimize Fabric pipelines for high performance and availability.
  • Implement governance frameworks ensuring data lineage and compliance.

Benefits

  • Opportunity to lead a team and mentor fellow engineers.
  • Work on innovative projects involving AI integration and real-time analytics.
  • Engagement with a wide range of data technologies within the Microsoft ecosystem.
  • Collaborative environment with cross-functional teams.
  • Access to professional development resources and training.
Full Job Description
About the Role

We are seeking a Microsoft Fabric Data Engineer with 7+ years of experience for a lead role. The ideal candidate will be responsible for designing, developing, and deploying data pipelines, ensuring efficient data movement and integration within Microsoft Fabric.

Responsibilities

Data Pipeline Development: Design, develop, and deploy data pipelines within Microsoft Fabric, leveraging OneLake, Data Factory, and Apache Spark to ensure efficient, scalable, and secure data movement across systems.

ETL Architecture: Architect and implement ETL workflows optimized for Fabric's unified data platform, streamlining ingestion, transformation, and storage.

Data Integration: Build and manage integration solutions that unify structured and unstructured sources into Fabric's OneLake ecosystem. Utilize SQL, Python, Scala, and R for advanced data manipulation.

Fabric OneLake & Synapse: Leverage OneLake as the single data lake for enterprise-scale storage and analytics, integrating with Synapse Data Warehousing for big data processing and reporting.

Cross-functional Collaboration: Partner with Data Scientists, Analysts, and BI Engineers to ensure Fabric's data infrastructure supports Power BI, AI workloads, and advanced analytics.

Performance Optimization: Monitor, troubleshoot, and optimize Fabric pipelines for high availability, fast query performance, and minimal downtime.

Data Governance & Security: Implement governance and compliance frameworks within Fabric, ensuring data lineage, privacy, and security across the unified platform.

Leadership & Mentorship: Lead and mentor a team of engineers, oversee Fabric workspace design, code reviews, and adoption of new Fabric features.

Automation & Monitoring: Automate workflows and orchestration using Fabric Data Factory, Azure DevOps, and Airflow, ensuring smooth operations.

Documentation & Standards: Document Fabric pipeline architecture, data models, and ETL processes. Contribute to Fabric engineering best practices and enterprise guidelines.

Innovation: Stay current with Fabric's evolving capabilities (Real-Time Analytics, Data Activator, AI integration) and drive innovation within the team.

Qualifications

7+ years of experience in data engineering, with a strong focus on Microsoft Fabric and related technologies.

Required Skills

Proficiency in SQL, Python, Scala, and R.

Experience with data pipeline development and ETL processes.

Strong understanding of data governance and security practices.

Ability to lead and mentor a team effectively.

Preferred Skills

Experience with Azure DevOps and Airflow.

Familiarity with Power BI and AI workloads.

Knowledge of real-time analytics and data activator features.

Pay range and compensation package

Competitive salary based on experience and qualifications.

Primary Skills
  • AKS, Event Hub, Azure DevOps, Cosmos DB, Azure Functions
Specialization
Job requirements

About Brillio

Brillio is a technology consulting and technology services company focused on the implementation of digital technologies.

Brillio Careers

There has never been a more opportune time to join Brillio—the forefront of innovation and digital transformation.

Opportunities Await

Brillio offers a plethora of job opportunities aimed at harnessing the potential of professionals eager to drive change. With a focus on technology and consulting, Brillio is not just a company; it's a vibrant ecosystem conducive to growth and professional development.

Transform Your Career

Embark on a journey of growth and leadership at Brillio. This is where industry expertise meets digital innovation to transform businesses and industries. Brillio stands out in the marketplace, providing a unique blend of technology solutions and strategic insights.

Join a Diverse and Inclusive Team

Brillio is committed to diversity and inclusion, ensuring a wide range of perspectives that fuel innovation and creative solutions. The team at Brillio, enriched with diverse skills and backgrounds, collaborates to deliver excellence and drive success.

Internship Programs and Employment

Kickstart your career with Brillio's internship programs, designed to offer hands-on experience and a gateway to full-time employment. Brillio is dedicated to nurturing young talent, providing them with the necessary tools and guidance to excel.

Innovate and Lead

At Brillio, every team member is an innovator and leader. The company fosters a culture of continuous learning and improvement, encouraging each individual to push boundaries and contribute to groundbreaking projects.

Networking and Professional Development

Networking at Brillio opens doors to influential connections, mentorship, and collaborative opportunities. Brillio supports career advancement through professional development, offering training in leadership, diversity, and specific job skills.

Benefits and Culture

Brillio is known for its dynamic culture and the comprehensive benefits it offers. Team members enjoy a supportive environment that values their well-being and professional growth.

Explore Job Positions

Brillio is hiring! Explore the various positions available that match your skills and interests. Brillio seeks passionate, curious, and solution-driven professionals ready to make an impact.

Prepare for Your Interview

Brillio helps candidates succeed by providing resources on how to effectively prepare your resume and ace the interview process. Stand out as a prospective employee by demonstrating your knowledge and enthusiasm for Brillio's mission.

Stay Connected with Brillio Careers

Keep up to date with career tips, industry insights, and the latest job openings at Brillio. Personalize your job search and stay informed about new and exciting opportunities within the company.

APPLY TO BRILLIO JOBS

Read Careers Blog

Stay ahead in your career with insights from Brillio's experts. Discover articles and advice tailored to advancing your career and enhancing your professional journey.

Job Alert Emails

Subscribe to receive customized job alerts and the latest news from Brillio. Discover the rewarding career opportunities that await and how Brillio can be the key to your professional future.
Learn more about Brillio
Industry
Technical Services
Founded
2014
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at Brillio

More Enterprise Technology Jobs

Find similar Principal Data Engineer - R01558819 jobs:

NationwideDallas, TX