Data Engineer, Specialist

Vanguard Group, Inc.

$110K — $130K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years relevant work experience; 2+ years in ETL & data pipeline design
  • Bachelor’s degree or equivalent experience
  • Strong SQL, Python, or Scala expertise
  • Hands-on experience with big data frameworks: Apache Spark, Hadoop, Kafka
  • Experience with AWS Redshift, Google Big Query, or Azure Synapse
  • Strong understanding of relational & NoSQL databases (PostgreSQL, MySQL, MongoDB, Cassandra)

Responsibilities

  • Writes ETL processes and designs database systems for real-time and offline analytics
  • Troubleshoots data consistency and integrity across large-scale integrations
  • Translates business specs into design specs, writing complex programs and queries
  • Partners with internal clients to understand business functions and data needs
  • Leads all phases of solution development, explaining technical details to stakeholders
  • Tests code for accuracy, reviewing the final product with clients
  • Designs and conducts training sessions on team tools and data sources

Benefits

  • Comprehensive health and wellness programs
  • Opportunities for professional development and training
  • Dynamic work environment fostering collaboration
  • Employee performance recognition programs
  • Support for work-life balance initiatives
Full Job Description

Core Responsibilities

Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data availability. Ensures that data pipelines are scalable, repeatable, and secure. Utilizes a deep dive analytical skillset on a variety of internal and external data.

1. Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing.

2. Troubleshoots software and processes for data consistency and integrity. Integrates large scale data from a variety of sources for business partners to generate insight and make decisions.

3. Translates business specifications into design specifications and code. Responsible for writing complex programs, ad hoc queries, and reports. Ensures that all code is well structured, includes sufficient documentation, and is easy to maintain and reuse.

4. Partners with internal clients to gain an enhanced understanding of business functions and informational needs. Gains expertise in tools, technologies, and applications/databases in specific business areas and company-wide systems.

5. Leads all phases of solution development. Explains technical considerations at related meetings, including those with internal clients and less experienced team members.

6. Tests code thoroughly for accuracy of intended purpose. Reviews end product with the client to ensure adequate understanding. Provides data analysis guidance as required.

7. Designs and conducts training sessions on tools and data sources used by the team and self provisioners. Provides job aids to team members and business users.

8. Tests and implements new software releases through regression testing. Identifies issues and engages with vendors to resolve and elevate software into production.

9. Participates in special projects and performs other duties as assigned.


Qualifications

  • Minimum 5 years of relevant work experience, with at least 2 years in designing and maintaining data pipelines, ETL processes and database architectures.
  • Bachelor’s degree or equivalent experience
  • Strong expertise in SQL, Python, or Scala for data processing, automation and transformation.
  • Hands-on experience with big data frameworks such as Apache Spark, Hadoop, or Kafka for real-time and batch processing.
  • Experience in cloud data platforms including AWS Redshift, Google Big Query, or Azure Synapse, with proficiency in cloud-native ETL and data pipeline tools.
  • Strong understanding of data modeling principles, relational and NoSQL databases (PostgreSQL, MySQL, MongoDB, Cassandra).

Special Factors

Sponsorship

Vanguard is not offering visa sponsorship for this position.

Similar Jobs

More Jobs at Vanguard Group, Inc.

More Information Technology Jobs

Find similar Data Engineer, Specialist jobs: