Brillio

Lead Data Engineer - R01568940

Brillio$120K — $125K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years' experience with SQL
  • 5+ years' experience designing and implementing scalable ETL processes
  • 3+ years' experience with modern Big Data Analytics using Data Lake and Spark
  • 2+ years' experience building cloud-hosted data systems, preferably Azure
  • Experience in applying AI/ML to data engineering use cases is preferred.

Responsibilities

  • Build and support modern data architecture at scale.
  • Design and implement state-of-the-art ETL processes using Databricks and Data Factory.
  • Work closely with business, design, test, and development teams to shape data capture methodologies.
  • Create large-scale lakehouse and warehouse analytics systems for real-time and batch processing.
  • Ensure high-quality data movement and maintain data quality standards.
  • Prepare and govern datasets for AI applications and experimentation testing.
  • Utilize attention to detail to enhance data-driven development practices.

Benefits

  • Access to cutting-edge technology and tools
  • Opportunity to work in a collaborative team environment
  • Focus on modern engineering practices
  • Engagement in impactful decision-making processes
  • Chance to influence data-driven development across the studio.
Full Job Description
Lead Data Engineer

Primary Skills

  • AKS, Event Hub, Azure DevOps, Cosmos DB, Azure Functions


Specialization

  • Azure Data Engineering Advanced: Senior Data Engineer


Job requirements

  • Data Engineer:
    Turn 10 Studios is looking for a Data Engineer to join the Data Pipeline team. As a member of the team, you will get to live on the front edge of modern technology by building on things like Databricks, Azure Synapse Analytics and Azure Data Explorer while building ETLs and process in Databricks and Data Factory. You will help build state of the art pipelines and data models that are at the heart of the studio decision-making process. You will be working on large-scale lakehouse and warehouse analytics systems that process data feeds in real-time and batch processes. Your customers will be the business, design, test and development teams and they will look to you to help shape how we capture data to improve our test-driven methodologies and build a culture around data driven development.
    The successful candidate will bring an attention to detail along with modern engineering practices and help us build and support a high quality, modern data architecture at scale.
    Qualifications:
    • 5+ years' experience with SQL required.
    • 5+ years' experience designing and implementing scalable ETL processes including data movement and quality tools.
    • 3+ years' experience with modern Big Data Analytics using Data Lake, Spark and formats like Parquet.
    • 2+ years' experience building cloud hosted data systems. Azure highly preferred.
    Preferred:
    • Building data pipelines in Azure Databricks/Fabric/Spark.
    • Working with data in delta lake format and from Azure Data Explorer/Kusto
    • Applying AI/ML to data engineering use cases (feature engineering, feature stores, model training/serving datasets, and model monitoring data pipelines).
    • Experience preparing and governing datasets for modern AI applications (LLM/RAG, experimentation/A-B testing, and privacy-aware data access).


$120 - $125 a year

Know what it's like to work and grow at Brillio: Click here

About Brillio

Brillio is a technology consulting and technology services company focused on the implementation of digital technologies.

Brillio Careers

There has never been a more opportune time to join Brillio—the forefront of innovation and digital transformation.

Opportunities Await

Brillio offers a plethora of job opportunities aimed at harnessing the potential of professionals eager to drive change. With a focus on technology and consulting, Brillio is not just a company; it's a vibrant ecosystem conducive to growth and professional development.

Transform Your Career

Embark on a journey of growth and leadership at Brillio. This is where industry expertise meets digital innovation to transform businesses and industries. Brillio stands out in the marketplace, providing a unique blend of technology solutions and strategic insights.

Join a Diverse and Inclusive Team

Brillio is committed to diversity and inclusion, ensuring a wide range of perspectives that fuel innovation and creative solutions. The team at Brillio, enriched with diverse skills and backgrounds, collaborates to deliver excellence and drive success.

Internship Programs and Employment

Kickstart your career with Brillio's internship programs, designed to offer hands-on experience and a gateway to full-time employment. Brillio is dedicated to nurturing young talent, providing them with the necessary tools and guidance to excel.

Innovate and Lead

At Brillio, every team member is an innovator and leader. The company fosters a culture of continuous learning and improvement, encouraging each individual to push boundaries and contribute to groundbreaking projects.

Networking and Professional Development

Networking at Brillio opens doors to influential connections, mentorship, and collaborative opportunities. Brillio supports career advancement through professional development, offering training in leadership, diversity, and specific job skills.

Benefits and Culture

Brillio is known for its dynamic culture and the comprehensive benefits it offers. Team members enjoy a supportive environment that values their well-being and professional growth.

Explore Job Positions

Brillio is hiring! Explore the various positions available that match your skills and interests. Brillio seeks passionate, curious, and solution-driven professionals ready to make an impact.

Prepare for Your Interview

Brillio helps candidates succeed by providing resources on how to effectively prepare your resume and ace the interview process. Stand out as a prospective employee by demonstrating your knowledge and enthusiasm for Brillio's mission.

Stay Connected with Brillio Careers

Keep up to date with career tips, industry insights, and the latest job openings at Brillio. Personalize your job search and stay informed about new and exciting opportunities within the company.

APPLY TO BRILLIO JOBS

Read Careers Blog

Stay ahead in your career with insights from Brillio's experts. Discover articles and advice tailored to advancing your career and enhancing your professional journey.

Job Alert Emails

Subscribe to receive customized job alerts and the latest news from Brillio. Discover the rewarding career opportunities that await and how Brillio can be the key to your professional future.
Learn more about Brillio
Industry
Founded
2014

Similar Jobs

More Jobs at Brillio

More Information Technology Jobs

Find similar Lead Data Engineer - R01568940 jobs: