Data Engineer

Compunnel

$90K — $130K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field
  • 5+ years of experience in data engineering roles
  • 4+ years of Java development experience with Spring frameworks (Spring Batch preferred)
  • 2+ years of experience with AWS services and cloud development
  • 2+ years of experience with SQL (Oracle, Snowflake)
  • 1+ years of Python development experience
  • Strong data modeling and analysis skills

Responsibilities

  • Design and develop scalable data solutions using Java Spring Batch, Python, and SQL
  • Build and maintain data pipelines and applications on AWS, including AWS Batch, S3, and IAM
  • Perform data analysis and modeling using 3NF and Star Schema designs
  • Optimize SQL queries for performance and reliability
  • Develop Unix shell scripts and manage job scheduling using Control-M
  • Collaborate with cross-functional teams to gather requirements and deliver data solutions
  • Support DevOps practices including CI/CD using Jenkins, Terraform, and CloudFormation

Benefits

  • Opportunity to work with advanced data technologies in a financial services context
  • Collaborative work environment with cross-functional teams
  • Focus on continuous learning and development in data engineering and DevOps
  • Exposure to innovative solutions and practices in cloud-based data platforms
  • Engagement in the entire data lifecycle from ingestion to reporting
Full Job Description
Job Summary

We are seeking a highly motivated Data Engineer to design, build, and maintain operational and analytical capabilities within our data platforms.

The ideal candidate will have strong experience in Java Spring Batch, Python, AWS, Oracle, and Snowflake, and will contribute to the ingestion of new financial products into our data ecosystem to support compensation, sales, and reporting functions.

Key Responsibilities
  • Design and develop scalable data solutions using Java Spring Batch, Python, and SQL.
  • Build and maintain data pipelines and applications on AWS, including AWS Batch, S3, and IAM.
  • Work with Oracle and Snowflake databases to support data ingestion and transformation.
  • Perform data analysis and modeling using 3NF and Star Schema designs.
  • Optimize SQL queries for performance and reliability.
  • Develop Unix shell scripts and manage job scheduling using Control-M.
  • Collaborate with cross-functional teams to gather requirements and deliver data solutions.
  • Support DevOps practices including CI/CD using Jenkins, Terraform, and CloudFormation.
  • Build and deploy containerized applications using Docker.
  • Ensure data quality, integrity, and compliance with internal standards.


Required Qualifications
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 5+ years of experience in data engineering roles.
  • 4+ years of Java development experience with Spring frameworks; Spring Batch preferred.
  • 2+ years of experience with AWS services and cloud-based development.
  • 2+ years of experience with SQL (Oracle, Snowflake).
  • 1+ years of Python development experience.
  • Experience with Unix shell scripting and job orchestration tools.
  • Strong data modeling and analysis skills.
  • Familiarity with Agile methodologies (Kanban, Scrum).
  • Excellent communication and collaboration skills.


Preferred Qualifications
  • Experience in the financial services industry.
  • Hands-on experience with DevOps tools and practices.
  • Knowledge of containerization and cloud-native development.


Education: Bachelors Degree

Similar Jobs

More Jobs at Compunnel

More Information Technology Jobs

Find similar Data Engineer jobs: