5+ years of experience in data engineering, with 2+ years on Databricks
Strong expertise in ETL processes and pipeline development
Proficient in advanced SQL, including optimization techniques
Skilled in Python programming for data engineering tasks
Experience in data warehousing and data modeling
Knowledge of PLSQL and T-SQL for stored procedures
Bachelor's degree in a relevant field, with certifications in Databricks or Azure preferred
Responsibilities
Architect and optimize scalable data solutions on Databricks
Develop and maintain robust ETL pipelines using SQL and Python
Design and implement data warehousing solutions for analytics
Automate data transformations with complex stored procedures
Lead requirements gathering and solution architecture efforts
Monitor and troubleshoot data workflows for performance optimization
Enforce data governance and compliance best practices
Benefits
Opportunities for professional growth and development
Access to cutting-edge technology and tools
Collaborative work environment with cross-functional teams
Focus on data governance and security best practices
Support for continuous learning and certifications
Full Job Description
Data Specialist
Primary Skills
ETL Fundamentals, SQL, SQL (Basic + Advanced), Python, Data Warehousing, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures
Specialization
Databricks Engineering: Data Architect
Job requirements
Experience Range: With at least 5 years of experience in data engineering, including 2+ years specifically working with Databricks and modern data platforms Key Responsibilities: 1. Architect and optimize scalable data solutions on Databricks to ensure high performance and reliability 2. Develop and maintain robust ETL pipelines using advanced SQL, Python, and Databricks features for processing large-scale datasets 3. Design and implement data warehousing solutions, including data modeling and schema design, to support analytics and business intelligence 4. Automate data transformations and integrations by developing, testing, and deploying complex stored procedures with PLSQL and T-SQL 5. Lead requirements gathering and solution architecture with cross-functional teams to deliver high-quality data products 6. Monitor and troubleshoot data workflows, optimizing performance to maintain data accuracy, integrity, and availability 7. Enforce best practices in data governance, security, and compliance within Databricks environments 8. Document technical designs, engineering processes, and operational procedures for ongoing support and knowledge sharing Required Skills: 1. Expertise in Databricks platform and ecosystem 2. Advanced ETL pipeline development 3. Advanced SQL, including query optimization and complex joins 4. Python programming for data engineering 5. Data warehousing implementation and data modeling 6. PLSQL and T-SQL for stored procedure development 7. Experience with modern data platform architectures Preferred Skills: 1. Integration of Databricks with Azure or AWS cloud platforms 2. Proficiency in Apache Spark and distributed data processing 3. Experience with CI/CD automation for data engineering 4. Familiarity with data quality frameworks 5. Experience with real-time data streaming and processing Desired Qualifications: 1. Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related discipline 2. Databricks Data Engineer Associate certification or higher 3. Microsoft Certified: Azure Data Engineer Associate or equivalent SQL/Python certification
Know what it's like to work and grow at Brillio: Click here
About Brillio
Brillio is a technology consulting and technology services company focused on the implementation of digital technologies.
Brillio Careers
There has never been a more opportune time to join Brillio—the forefront of innovation and digital transformation.
Opportunities Await
Brillio offers a plethora of job opportunities aimed at harnessing the potential of professionals eager to drive change. With a focus on technology and consulting, Brillio is not just a company; it's a vibrant ecosystem conducive to growth and professional development.
Transform Your Career
Embark on a journey of growth and leadership at Brillio. This is where industry expertise meets digital innovation to transform businesses and industries. Brillio stands out in the marketplace, providing a unique blend of technology solutions and strategic insights.
Join a Diverse and Inclusive Team
Brillio is committed to diversity and inclusion, ensuring a wide range of perspectives that fuel innovation and creative solutions. The team at Brillio, enriched with diverse skills and backgrounds, collaborates to deliver excellence and drive success.
Internship Programs and Employment
Kickstart your career with Brillio's internship programs, designed to offer hands-on experience and a gateway to full-time employment. Brillio is dedicated to nurturing young talent, providing them with the necessary tools and guidance to excel.
Innovate and Lead
At Brillio, every team member is an innovator and leader. The company fosters a culture of continuous learning and improvement, encouraging each individual to push boundaries and contribute to groundbreaking projects.
Networking and Professional Development
Networking at Brillio opens doors to influential connections, mentorship, and collaborative opportunities. Brillio supports career advancement through professional development, offering training in leadership, diversity, and specific job skills.
Benefits and Culture
Brillio is known for its dynamic culture and the comprehensive benefits it offers. Team members enjoy a supportive environment that values their well-being and professional growth.
Explore Job Positions
Brillio is hiring! Explore the various positions available that match your skills and interests. Brillio seeks passionate, curious, and solution-driven professionals ready to make an impact.
Prepare for Your Interview
Brillio helps candidates succeed by providing resources on how to effectively prepare your resume and ace the interview process. Stand out as a prospective employee by demonstrating your knowledge and enthusiasm for Brillio's mission.
Stay Connected with Brillio Careers
Keep up to date with career tips, industry insights, and the latest job openings at Brillio. Personalize your job search and stay informed about new and exciting opportunities within the company.
APPLY TO BRILLIO JOBS
Read Careers Blog
Stay ahead in your career with insights from Brillio's experts. Discover articles and advice tailored to advancing your career and enhancing your professional journey.
Job Alert Emails
Subscribe to receive customized job alerts and the latest news from Brillio. Discover the rewarding career opportunities that await and how Brillio can be the key to your professional future.