Experience Range: 7 to 10 years of experience in advanced AWS data engineering, including significant expertise in Master Data Management (MDM) with Stibo and designing large-scale data solutions Key Responsibilities:
Design and architect scalable data pipelines and solutions using AWS native services to support complex business requirements
Develop, implement, and optimize ETL processes leveraging AWS technologies such as EMR, Redshift, Athena, and DMS
Configure and manage real-time data streaming and ingestion frameworks utilizing Kinesis and Amazon API Gateway
Monitor, troubleshoot, and enhance data infrastructure performance using CloudWatch and Open Search
Automate deployment and infrastructure provisioning with CloudFormation and manage schema migrations using SCT
Lead the implementation and integration of Master Data Management (MDM) solutions using Stibo within enterprise data platforms
Collaborate with cross-functional teams to integrate data solutions with enterprise applications and analytics platforms
Ensure data security, quality, and compliance by implementing best practices and leveraging AWS security features
Lead technical reviews, mentor junior engineers, and drive adoption of emerging data technologies within the organization
Required Skills:
Advanced proficiency in AWS services including SNS, SQS, Amazon API Gateway, Athena, CloudFormation, CloudWatch, DMS, DynamoDB, EMR, Kinesis, Open Search, Redshift, SCT
Expertise in designing and managing data pipelines and ETL workflows on AWS
Strong experience with Spark using Scala for large-scale data processing
Hands-on experience with Oozie workflow scheduling and orchestration
Deep knowledge of real-time data streaming with AWS Kinesis
Proven ability to configure and optimize Amazon Redshift for analytics workloads
Experience with DynamoDB for NoSQL database solutions
Ability to automate infrastructure and deployments using AWS CloudFormation
Proficient in monitoring and logging with AWS CloudWatch
Skill in managing data migration and schema transformation using AWS SCT and DMS
Demonstrated expertise in implementing and integrating MDM solutions using Stibo
Preferred Skills:
Experience integrating AWS data solutions with third-party analytics and visualization tools
Proficiency in optimizing performance for large-scale distributed data systems
Knowledge of emerging AWS data services and staying current with industry best practices
Experience with Open Search for search and analytics use cases
Background in mentoring and leading engineering teams in cloud data projects
Familiarity with advanced data governance and data quality frameworks in MDM environments
Desired Qualifications:
Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a closely related discipline
AWS Certified Data Analytics - Specialty or AWS Certified Solutions Architect - Professional
Certification in Apache Spark or relevant big data technologies (preferred)
About Brillio
Brillio is a technology consulting and technology services company focused on the implementation of digital technologies.
Brillio Careers
There has never been a more opportune time to join Brillio—the forefront of innovation and digital transformation.
Opportunities Await
Brillio offers a plethora of job opportunities aimed at harnessing the potential of professionals eager to drive change. With a focus on technology and consulting, Brillio is not just a company; it's a vibrant ecosystem conducive to growth and professional development.
Transform Your Career
Embark on a journey of growth and leadership at Brillio. This is where industry expertise meets digital innovation to transform businesses and industries. Brillio stands out in the marketplace, providing a unique blend of technology solutions and strategic insights.
Join a Diverse and Inclusive Team
Brillio is committed to diversity and inclusion, ensuring a wide range of perspectives that fuel innovation and creative solutions. The team at Brillio, enriched with diverse skills and backgrounds, collaborates to deliver excellence and drive success.
Internship Programs and Employment
Kickstart your career with Brillio's internship programs, designed to offer hands-on experience and a gateway to full-time employment. Brillio is dedicated to nurturing young talent, providing them with the necessary tools and guidance to excel.
Innovate and Lead
At Brillio, every team member is an innovator and leader. The company fosters a culture of continuous learning and improvement, encouraging each individual to push boundaries and contribute to groundbreaking projects.
Networking and Professional Development
Networking at Brillio opens doors to influential connections, mentorship, and collaborative opportunities. Brillio supports career advancement through professional development, offering training in leadership, diversity, and specific job skills.
Benefits and Culture
Brillio is known for its dynamic culture and the comprehensive benefits it offers. Team members enjoy a supportive environment that values their well-being and professional growth.
Explore Job Positions
Brillio is hiring! Explore the various positions available that match your skills and interests. Brillio seeks passionate, curious, and solution-driven professionals ready to make an impact.
Prepare for Your Interview
Brillio helps candidates succeed by providing resources on how to effectively prepare your resume and ace the interview process. Stand out as a prospective employee by demonstrating your knowledge and enthusiasm for Brillio's mission.
Stay Connected with Brillio Careers
Keep up to date with career tips, industry insights, and the latest job openings at Brillio. Personalize your job search and stay informed about new and exciting opportunities within the company.
APPLY TO BRILLIO JOBS
Read Careers Blog
Stay ahead in your career with insights from Brillio's experts. Discover articles and advice tailored to advancing your career and enhancing your professional journey.
Job Alert Emails
Subscribe to receive customized job alerts and the latest news from Brillio. Discover the rewarding career opportunities that await and how Brillio can be the key to your professional future.
