Sr. Data Engineer - Java

Veracity Solutions

$100K — $130K *
Finance & Insurance
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 10+ years in data engineering or related field
  • Proficient in Java and Spring frameworks
  • Experienced with big data tools: Hadoop, HDFS, ADLS, ADF, Spark, Kafka, Databricks, Dremio
  • Knowledge of relational SQL and NoSQL databases, particularly Cassandra
  • 5+ years in Capital Markets
  • Familiar with Agile methodologies
  • Exposure to Python and/or Scala is a plus

Responsibilities

  • Create and maintain optimal data pipeline architecture
  • Implement curated data products and custom models
  • Ensure data quality and integrity across systems
  • Optimize pipelines for performance and scalability
  • Provide technical support for incident resolution
  • Develop and document detailed solution designs
  • Create functional and technical designs based on requirements
  • Identify cost-effective solutions to improve stakeholder experience
  • Conduct code reviews for quality and standards compliance
  • Stay updated with industry trends and technologies

Benefits

  • Hybrid work model (2 days onsite)
  • Opportunity for career growth in a robust field
  • Exposure to cutting-edge technologies
  • Collaborative work environment with Agile teams
  • Involvement in high-impact projects within Capital Markets
Full Job Description
Job Title: Sr. Data Engineer - Java

Job Location: Toronto, ON (Hybrid - 2 days/week onsite)

# Positions: 2

Employment Type: FTE

Key Technology: Java, Big Data

Job Responsibilities:
• Create and maintain optimal data pipeline architecture
• Implement data products curated by our Chief Data Office, as well as custom data models for fit for use.
• Ensure data quality and integrity across various data sources and systems to ensure data accuracy, completeness, and reliability.
• Optimize data pipelines for performance and scalability.
• Provide technical support to promptly resolve escalated incidents/outages.
• Develop and document a detailed solution design, impart your subject matter expertise throughout life cycle.
• Take business, Enterprise Architecture, system performance and development standards requirements, then develop functional, technical and user interface designs for an application and/or system.
• Find ways to keep costs low, help come up with strategic solutions to support cost effectiveness and enhance stakeholder experience.
• Conduct code reviews to address quality, standards compliance, reusability and ease of maintenance, Operational Readiness Reviews, and support gating and review signoffs for solution design.
• Ensure design leverages existing reusable components, traces back to business requirements, and that new modules are designed with reusability in mind.
• Keep up to date with the latest industry trends and technologies related to data engineering.

Skills and Experience Required:

Required:
• 10+ years of relevant experience in a related field of job function.
• Experience with: Java, Spring,
• Experience with big data tools: Hadoop, HDFS, ADLS, ADF, Spark, Kafka, Databricks, Dremio etc.
• Experience with relational SQL and NoSQL databases, including Cassandra.
• Experience designing production grade, scalable applications and microservices.
• 5+ years of Capital Markets experience.
• Experience working on Agile Teams

Desired:
• Experience in Python and/or Scala

Similar Jobs

More Jobs at Veracity Solutions

More Finance & Insurance Jobs

Find similar Sr. Data Engineer - Java jobs: