Brillio

Senior Lead Data Engineer - R01568572

Brillio$120K — $150K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience in data pipeline design and implementation
  • Strong skills in handling structured and unstructured data, including JSON
  • Proficient in advanced SQL for data transformation
  • 3+ years of Python and PySpark experience for large-scale processing
  • Hands-on experience with AWS data solutions and DataBricks
  • Competent with Git and CI/CD practices in data development
  • Strong collaboration abilities with various data team members

Responsibilities

  • Design and develop scalable cloud-based data pipelines
  • Maintain large and complex datasets for business requirements
  • Apply best practices in database management and data security
  • Implement Data Quality checks to ensure data integrity
  • Collaborate with Data & Analytics experts to enhance platform capabilities
  • Provide optimized data delivery architectures across multiple systems
  • Participate in on-call support and proactively resolve user issues

Benefits

  • Flexible work environment
  • Opportunities for professional development
  • Access to cutting-edge technologies
  • Collaboration with a diverse team of experts
  • Contribution to impactful projects within the organization
Full Job Description
Senior Lead Data Engineer
Primary Skills
  • Athena, SNS, SQS, CloudWatch, Kinesis, Redshift
Specialization
  • AWS Data EngineerIng Advanced: Associate Data Engineer
Job requirements
  • The Senior Data Engineer, Platform will play a key role in building and scaling Organization's data and analytics foundation. This role focuses on designing, developing, and operating reliable, scalable, and cost effective data pipelines and platforms in the cloud. The ideal candidate is a hands on data engineer who can design data systems from the ground up while collaborating closely with software engineers, data analysts, and data scientists to enable consistent and high quality data delivery across the organization.
  • Key Responsibilities • Design, develop, and operationalize scalable, reliable, and performant cloud based data pipelines. • Build and maintain large, complex datasets that meet both functional and non functional business requirements. • Apply database management best practices, including logical data modeling, physical database optimization, and data security. • Implement and enhance Data Quality checks to ensure accuracy, integrity, and reliability of data pipelines. • Partner closely with Data & Analytics experts to continuously enhance data platform capabilities and usability. • Support multiple teams, systems, and products by providing consistent and optimized data delivery architectures. • Participate in on call support rotations and proactively unblock users based on issue severity and business impact. • Contribute to improving operational processes, monitoring, and reliability of data platforms.
  • Required Skills & Experience • 5+ years of experience designing, building, and operationalizing data pipelines for large and complex datasets. • Strong experience working with structured and unstructured data, including JSON. • Extensive hands on experience with advanced SQL for data transformation and analysis. • 3+ years of experience with Python and PySpark for large scale data processing. • Hands on experience transforming and processing data using Databricks. • 3+ years of experience building data solutions on AWS. • Experience using Git and CI/CD practices for data and platform development. • Strong collaboration skills with the ability to support data engineers, analysts, data scientists, and software engineers. • Self directed, ownership driven mindset with the ability to manage multiple concurrent priorities.
  • Nice to Have Skills • Experience with Power BI or similar business intelligence and visualization tools. • Familiarity with modern data lake and data warehouse architectures. • Experience implementing observability, monitoring, and alerting for data pipelines. • Exposure to streaming data technologies or near real time data processing. • Experience in a fast growing, platform focused or SaaS environment.

About Brillio

Brillio is a technology consulting and technology services company focused on the implementation of digital technologies.

Brillio Careers

There has never been a more opportune time to join Brillio—the forefront of innovation and digital transformation.

Opportunities Await

Brillio offers a plethora of job opportunities aimed at harnessing the potential of professionals eager to drive change. With a focus on technology and consulting, Brillio is not just a company; it's a vibrant ecosystem conducive to growth and professional development.

Transform Your Career

Embark on a journey of growth and leadership at Brillio. This is where industry expertise meets digital innovation to transform businesses and industries. Brillio stands out in the marketplace, providing a unique blend of technology solutions and strategic insights.

Join a Diverse and Inclusive Team

Brillio is committed to diversity and inclusion, ensuring a wide range of perspectives that fuel innovation and creative solutions. The team at Brillio, enriched with diverse skills and backgrounds, collaborates to deliver excellence and drive success.

Internship Programs and Employment

Kickstart your career with Brillio's internship programs, designed to offer hands-on experience and a gateway to full-time employment. Brillio is dedicated to nurturing young talent, providing them with the necessary tools and guidance to excel.

Innovate and Lead

At Brillio, every team member is an innovator and leader. The company fosters a culture of continuous learning and improvement, encouraging each individual to push boundaries and contribute to groundbreaking projects.

Networking and Professional Development

Networking at Brillio opens doors to influential connections, mentorship, and collaborative opportunities. Brillio supports career advancement through professional development, offering training in leadership, diversity, and specific job skills.

Benefits and Culture

Brillio is known for its dynamic culture and the comprehensive benefits it offers. Team members enjoy a supportive environment that values their well-being and professional growth.

Explore Job Positions

Brillio is hiring! Explore the various positions available that match your skills and interests. Brillio seeks passionate, curious, and solution-driven professionals ready to make an impact.

Prepare for Your Interview

Brillio helps candidates succeed by providing resources on how to effectively prepare your resume and ace the interview process. Stand out as a prospective employee by demonstrating your knowledge and enthusiasm for Brillio's mission.

Stay Connected with Brillio Careers

Keep up to date with career tips, industry insights, and the latest job openings at Brillio. Personalize your job search and stay informed about new and exciting opportunities within the company.

APPLY TO BRILLIO JOBS

Read Careers Blog

Stay ahead in your career with insights from Brillio's experts. Discover articles and advice tailored to advancing your career and enhancing your professional journey.

Job Alert Emails

Subscribe to receive customized job alerts and the latest news from Brillio. Discover the rewarding career opportunities that await and how Brillio can be the key to your professional future.
Learn more about Brillio
Industry
Founded
2014

Similar Jobs

More Jobs at Brillio

More Information Technology Jobs

Find similar Senior Lead Data Engineer - R01568572 jobs: