Principal Data Engineer

Kaleidoscope Innovation

$120K — $145K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of strong experience in data engineering within enterprise environments.
  • Hands-on AWS experience, specifically with services like S3, Lambda, and DynamoDB.
  • Extensive expertise in Snowflake as a cloud data warehousing solution.
  • Advanced proficiency in Python and SQL for data manipulation and integration.
  • Solid background in ETL/ELT processes and data integration methods.
  • Familiarity with data modeling practices, especially Data Vault methodologies.
  • Experience utilizing dbt or similar frameworks for data transformation and workflow management.

Responsibilities

  • Design and build scalable data pipelines and integration solutions.
  • Develop architectures for enterprise data warehouses, lakes, and analytics platforms.
  • Create and enhance ETL/ELT processes using advanced data engineering tools.
  • Implement solutions leveraging AWS services like S3 and Lambda.
  • Design data solutions within Snowflake and other cloud platforms.
  • Establish data models and governance processes, ensuring data quality and lineage.
  • Lead technical discussions and provide guidance on best practices in data engineering.

Benefits

  • Collaborative and innovative work environment.
  • Opportunities for professional development and training.
  • Access to modern data technologies and tools.
  • Participation in complex and large-scale data projects.
Full Job Description
Job Posting Title

Principal Data Engineer

Job Description

*Applicants must be authorized to work for ANY employer in the U.S. We are unable to sponsor or take over sponsorship of an employment Visa at this time.*

Location: Charlotte, NC/Detroit, MI
Work Arrangement: Onsite
Job Type: Full-Time

Job Overview

We are seeking an experienced Principal Data Engineer to design, develop, and maintain scalable data solutions supporting enterprise data engineering and analytics initiatives. This role will work across data engineering, data warehousing, data integration, and cloud technologies to build reliable and high-performing data platforms.

The ideal candidate has strong hands-on experience with AWS, Snowflake, Python, SQL, ETL/ELT, and modern data engineering practices, along with the ability to work across complex enterprise data environments.

Key Responsibilities
  • Design, develop, and optimize scalable data pipelines and data integration solutions.
  • Develop and maintain data architectures supporting enterprise data warehouses, data lakes, and analytics platforms.
  • Build and optimize ETL/ELT processes using modern data engineering tools and technologies.
  • Develop solutions using AWS services including S3, Lambda, and DynamoDB.
  • Design and implement data solutions within Snowflake and other cloud-based data environments.
  • Develop and maintain data models, including Data Vault modeling methodologies.
  • Write and optimize complex SQL and Python code for data processing and integration.
  • Work with dbt to develop, transform, test, and manage data workflows.
  • Support data replication and integration using tools such as Qlik Replicate.
  • Work with enterprise data platforms including IBM InfoSphere DataStage and CP4D.
  • Develop and integrate APIs to support enterprise data and application needs.
  • Establish and maintain data quality, governance, metadata management, and data lineage processes.
  • Collaborate with engineering, architecture, analytics, and business teams to translate requirements into scalable data solutions.
  • Troubleshoot performance, data quality, and integration issues across complex data environments.
  • Provide technical leadership and guidance on data engineering architecture and best practices.

Required Qualifications
  • Strong experience in data engineering and enterprise data environments.
  • Hands-on experience with AWS, particularly S3, Lambda, and/or DynamoDB.
  • Strong experience with Snowflake and cloud data warehousing.
  • Advanced Python and SQL development skills.
  • Experience developing ETL/ELT and data integration solutions.
  • Experience with data warehousing and data modeling, including Data Vault.
  • Experience with dbt or similar modern data transformation frameworks.
  • Experience with data quality, governance, metadata management, and data lineage.
  • Strong understanding of relational and non-relational databases.
  • Experience with enterprise data integration platforms and tools.
  • Ability to work independently while providing technical leadership to other engineers.

Preferred Qualifications
  • Experience with Qlik Replicate.
  • Experience with IBM InfoSphere DataStage.
  • Experience with IBM CP4D.
  • Experience developing and integrating APIs.
  • Experience with NoSQL databases.
  • Experience working with Git and DevOps practices.
  • Experience in large-scale enterprise environments.
  • Strong communication and cross-functional collaboration skills.


Work Environment

This is an onsite position that requires the ability to work from the client site on a regular basis.

Similar Jobs

More Jobs at Kaleidoscope Innovation

  • Python Developer
    $120K — $145K *
    Fort Washington, MD 20744 (Prince Georges County)
    Information Technology
    In-Person
  • Python Developer
    $120K — $145K *
    Washington, DC 20011 (District Of Columbia County)
    Information Technology
    In-Person
  • Principal Data Engineer
    $120K — $145K *
    Charlotte, NC 28269 (Mecklenburg County)
    Information Technology
    In-Person
  • Senior/Principal Mechanical Design Engineer
    $120K — $145K *
    Boston, MA 02115 (Suffolk County)
    Manufacturing & Automotive
    In-Person
  • PLM Solution Architect
    $150K — $180K *
    San Jose, CA 95123 (Santa Clara County)
    Enterprise Technology
    In-Person

More Information Technology Jobs

Find similar Principal Data Engineer jobs: