Data Engineer

Compunnel

$90K — $130K *
Wayne, PA 19087In-Person
Enterprise Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree or equivalent experience.
  • 5+ years in data analytics, data engineering, or related fields.
  • Proficiency in ETL development and data integration.
  • Strong programming skills in SQL and Python.
  • Familiarity with AWS services and building CI/CD pipelines.
  • Experience with Snowflake and data governance practices.
  • Strong analytical and problem-solving capabilities.

Responsibilities

  • Design and maintain scalable ETL processes for data integration.
  • Optimize database systems for real-time and batch processing.
  • Integrate large-scale data for analytics and BI initiatives.
  • Troubleshoot and ensure data pipeline integrity and reliability.
  • Translate business requirements into technical solutions.
  • Develop complex SQL queries and data processing programs.
  • Lead development phases from design to deployment.

Benefits

  • Collaborative work environment with cross-functional teams.
  • Opportunity to work with cutting-edge cloud technologies.
  • Engagement in special projects to enhance skills.
  • On-the-job training and knowledge-sharing sessions.
  • Hybrid work environment with flexible remote options.
Full Job Description
Job Summary

We are seeking a Data Engineer to design, develop, and maintain scalable data pipelines that enable efficient data integration, processing, and analytics across enterprise platforms. This role is responsible for building ETL solutions, optimizing databases, supporting business intelligence initiatives, and leveraging modern cloud-based data technologies. The ideal candidate will have experience with AWS, Snowflake, SQL, Python, ETL development, and data governance while collaborating with cross-functional teams to deliver high-quality data solutions.

Key Responsibilities
• Design, develop, and maintain scalable ETL (Extract, Transform, Load) processes to support enterprise data integration.
• Build and optimize database systems for real-time and batch analytical processing.
• Integrate large-scale data from multiple sources to support business intelligence and analytics initiatives.
• Troubleshoot data pipelines, software, and processes to ensure data consistency, integrity, and reliability.
• Translate business requirements into technical designs and scalable data solutions.
• Develop complex SQL queries, data processing programs, reports, and reusable code.
• Ensure code is well-structured, documented, maintainable, and reusable.
• Collaborate with business stakeholders to understand data requirements and deliver effective solutions.
• Lead all phases of solution development from design through implementation and deployment.
• Communicate technical concepts and solution designs to business partners and technical teams.
• Perform comprehensive testing and validation of data solutions to ensure quality and accuracy.
• Provide data analysis guidance and technical support to internal teams.
• Develop and deliver training materials, job aids, and knowledge-sharing sessions on data tools and technologies.
• Perform regression testing and implement new software releases into production environments.
• Collaborate with vendors to resolve software issues and support production deployments.
• Participate in special projects and perform additional responsibilities as needed.

Required Qualifications
• Bachelor's degree or equivalent combination of education and experience.
• 5+ years of experience in data analytics, data engineering, programming, database administration, or data management.
• Experience with data integration and ETL development.
• Experience with machine learning concepts and supporting data platforms.
• Experience with data governance principles and best practices.
• Strong SQL and Python programming skills.
• Experience with AWS services including Glue ETL, Lambda, Redshift, S3, and related cloud technologies.
• Experience building and supporting AWS infrastructure and CI/CD pipelines.
• Experience with Snowflake data platform.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and collaboration skills.
• Ability to work in a hybrid environment with onsite presence three days per week.

Preferred Qualifications
• Experience designing enterprise-scale data pipelines and analytics platforms.
• Experience supporting business intelligence and reporting initiatives.
• Experience with cloud-native data architectures and modern data engineering best practices.
• Experience working in Agile development environments.

Similar Jobs

More Jobs at Compunnel

  • Site Reliability Engineer
    $100K — $130K *
    Toronto, ON M3C 0E3
    Information Technology
    In-Person
  • Systems Analyst III
    $80K — $110K *
    Allentown, PA 18102 (Lehigh County)
    Information Technology
    In-Person
  • Project Manager
    $90K — $120K *
    Aliso Viejo, CA 92656 (Orange County)
    Business Services
    In-Person
  • Full Stack Engineer
    $100K — $130K *
    Durham, NC 27713 (Durham County)
    Information Technology
    In-Person
  • Data Engineer
    $90K — $130K *
    Wayne, PA 19087 (Delaware County)
    Enterprise Technology
    In-Person

More Enterprise Technology Jobs

Find similar Data Engineer jobs: