5-7 years of experience in data architecture or engineering
Proficiency in AWS for cloud solutions
Strong programming skills in Python
Familiarity with AWS Glue, Apache Spark, and Apache Kafka
Experience with Databricks is essential
Bachelor's or Master's degree in Computer Science, Engineering, or related field
Experience in on-premise data solutions is a plus
Responsibilities
Design and implement medallion architecture for data ingestion and processing
Develop ETL and streaming pipelines using Databricks and Apache tools
Define data quality frameworks with monitoring tools
Optimize data pipeline performance and costs
Lead technical discovery and development assessments
Provide technical recommendations and implementation roadmaps
Act as the liaison between engineering teams and business stakeholders
Define best practices and coding standards for data engineering teams
Benefits
Opportunity to work on cutting-edge projects
Join a highly motivated and dedicated team
Flexible work schedule
Comprehensive benefits package including medical, vision, and dental
Participate in corporate social events
Access to professional development opportunities
Work in a well-equipped office
Full Job Description
We are currently hiring a Big Data Architect for a hybrid role in Atlanta, GA
Essential functions
Data Architecture & Engineering
Design and implement medallion architecture (raw, silver, gold layers) to enable efficient data ingestion, processing, and quality management.
Develop standardized ETL and streaming pipelines using Databricks, Apache Spark, and Apache Airflow, ensuring low-latency data processing.
Define and enforce data quality and observability frameworks, integrating dashboards and monitoring tools to maintain high data integrity.
Optimize data pipeline performance and infrastructure costs, identifying bottlenecks and areas for improvement.
Technical Leadership & Strategy
Lead the technical discovering and ongoing development, assessing current systems, identifying pain points, and defining the target state architecture.
Provide technical recommendations and a roadmap for implementation, ensuring best practices in data engineering and architecture.
Guide the selection and implementation of cloud-based data platforms to support scalability, efficiency, and future growth.
Ensure compliance with security, governance, and regulatory requirements in data handling and processing.
Cross-Team Collaboration & Stakeholder Engagement
Act as the technical point of contact between engineering teams, business stakeholders, and management.
Work closely with team members to ensure smooth collaboration and knowledge transfer.
Translate business requirements into technical solutions, ensuring alignment between data engineering practices and business objectives.
Project Delivery & Execution
Define best practices, coding standards, and development workflows for data engineering teams.
Ensure a smooth transition from discovery to implementation, providing hands-on guidance and technical oversight.
Participate in planning and work closely with the Delivery Manager to manage timelines and priorities, various program related topics
Monitor and troubleshoot data pipeline performance, ensuring high availability and reliability of data systems.