Principal Data Engineer

Fidelity

$120K — $150K *
Finance & Insurance
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's or Master's degree in Computer Science, Engineering, IT, or related field.
  • 5+ years as a Principal Data Engineer in financial services (or 3+ with a Master's).
  • Expertise in translating business needs into technical specifications using SQL, Python, Java, or Scala.
  • Experience with CI/CD pipelines and automation using tools like GitHub and Jenkins.
  • Proficient in building data ingestion frameworks and working with AWS and Snowflake.

Responsibilities

  • Design, implement, and maintain data structures and batch jobs.
  • Develop innovative technical solutions for ongoing development efforts.
  • Create applications supporting various divisional initiatives.
  • Conduct user acceptance testing and support all phases of testing.
  • Generate thorough documentation for applications and corporate projects.
  • Ensure post-installation validation and troubleshooting of issues.
  • Establish project plans and manage data services across operational data stores.

Benefits

  • Comprehensive documentation and support for multiple corporate initiatives.
  • Collaborative work environment with systems analysts and software engineers.
  • Exposure to innovative technologies and platforms like Snowflake and AWS.
  • Opportunities for professional growth in technical and leadership capacities.
Full Job Description

Job Description:

Position Description:

Designs and delivers data lakes, data warehouses, and report platforms. Develops data and analytics solutions on Snowflake Cloud Platform andprovidestechnical guidance in the implementation and practice of relational database technologies and tools -- Snowflake, Oracle, SQL Server, and PL/SQL. Works with teams to support multiple source databases andbuildsextract replication metrics using replication and programming tools.Buildsautomated pipelines to deploy to various environments and services using Amazon Web Services (AWS), Python, Concourse, Jenkins core, and Groovy script.

Primary Responsibilities:

  • Designs, implements, andmaintainsdata structures, batch jobs, and interfaces to external systems.

  • Develops original and creative technical solutions toon-goingdevelopment efforts.

  • Developsapplications for multiple projects supporting several divisional initiatives.

  • Supports and performs all phases of testing leading to implementation.

  • Assistsin the planning and conducting of user acceptance testing.

  • Developscomprehensive documentation for multiple applications supporting several corporate initiatives.

  • Responsible for post-installation validation and triaging of any issues.

  • Establishes project plans for projects of moderate scope.

  • Performs independent and complex technical and functional analysis for multiple projects supporting several initiatives.

  • Manages data services hosted on the operational data stores and file-based interfaces.

  • Conferswith systems analysts and other software engineers/developers to design systems.

  • Gathers information on project limitations and capabilities, performance requirements, and interfaces.

  • Develops and oversees software system testing and validation procedures, programming, and documentation.

Education and Experience:

Bachelor27s degree in Computer Science, Engineering, Information Technology, Information Systems, or a closely related field(or foreign education equivalent)and five (5) years of experience as a Principal Data Engineer (or closely related occupation) designing and buildingdatabaseand data models in a financial services environment.

Or, alternatively,Master27s degree in Computer Science, Engineering, Information Technology, Information Systems, or a closely related field(or foreign education equivalent)and three (3) years of experience as a Principal Data Engineer (or closely related occupation) designing and buildingdatabaseand data models in a financial services environment.

Skills and Knowledge:

Candidate must alsopossess:

  • Demonstrated Expertise (5CDE5D) translating business requirements into technical validations -- examining data to determine accuracy, quality, or condition using SQL, Python, Java, and Scala; and automating the Continuous Integration and Continuous Delivery (CI/CD) Rest APIs pipeline for deployments using Stash, GitHub, Jenkins, anduDeploy.

  • 5CDE5D developing data ingestion frameworks using Python to load structured data from relational databases into a Cloud Software as a Service (SaaS) Data Lake Platform (Snowflake), using AWS, NIFI, Java, Snowflake, and Python.

  • 5CDE5D developing data masking, reconciliation framework, and comparison dashboard metrics using Bigdata, Python, Java, Snowflake, and Airflow.

  • 5CDE5D building metadata-driven frameworks for file feed data ingestion to load data into Snowflake using AWS, Python, Java, Snowflake, and Airflow.

#PE1M2

#LI-DNI


Certifications:

Category:

Information Technology

Similar Jobs

More Jobs at Fidelity

More Finance & Insurance Jobs

Find similar Principal Data Engineer jobs: