JP Morgan Chase & Co.

Lead Data Engineer - Pipelines, Spark Streaming and Spark Offline

JP Morgan Chase & Co.$100K — $140K *
Tampa, FL 33634In-Person
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Formal training or certification in Data Engineering with over 5 years of applied experience.
  • Experience with enterprise-level AI capabilities in data engineering workflows.
  • Ability to validate AI-generated outputs and adhere to strict data handling protocols.
  • Proficient in Python and PySpark programming languages.
  • Expertise in data lifecycle management, including building data frameworks and working with data lakes.
  • Hands-on experience with Batch and Real-time Data processing using Spark or Flink.
  • Familiarity with AWS Glue and EMR for data processing and real-time features.

Responsibilities

  • Collaborate with multiple business lines to deliver comprehensive software solutions.
  • Architect and develop efficient data pipelines and platforms that align with business needs.
  • Create scalable and reliable data processing pipelines for analytics.
  • Design features for machine learning applications using big data technologies.
  • Converge security architecture across physical and IT layers to manage data access effectively.
  • Implement AI-assisted practices in operational routines for improved delivery and traceability.

Benefits

  • Access to one of the leading financial institutions' vast resources and networking opportunities.
  • Exposure to state-of-the-art data engineering technologies and practices.
  • Collaborative work environment within an agile team dynamic.
  • Opportunities for professional training and certification advancement.
  • Focus on innovation with a commitment to data security and compliance.
Full Job Description
JOB DESCRIPTION

As a Lead Data Engineer at JPMorganChase within the Commercial & Investment Bank, you are an integral part of an agile team that works to enhance, build, and deliver data collection, storage, access, and analytics solutions in a secure, stable, and scalable way. As a core technical contributor, you are responsible for maintaining critical data pipelines and architectures across multiple technical areas within various business functions in support of the firm’s business objectives.

Job responsibilities

  • Collaborate with all of JPMorgan’s lines of business and functions to delivery software solutions
  • Experiment, Architect, develop and productionize efficient Data pipelines, Data services and Data platforms contributing to the business
  • Design and implement highly scalable, efficient and reliable data processing pipelines and perform analysis and insights to drive and optimize business result
  • Design and develop features and entities for ML and rule using spark or any bigdata environment
  • Acts on previously identified opportunities to converge physical, IT, and data security architecture to manage access
  • Applies reuse-first, AI-assisted practices within delivery and operational routines (e.g., backup/recovery validation and access control review support), ensuring traceability/auditability and alignment to resiliency and security expectations

 

Required qualifications, capabilities, and skills

  • Formal training or certification on Data Engineering concepts and 5+ years applied experience

     

  • Demonstrated experience using enterprise-authorized AI capabilities within the work environment to support data engineering workflows with strong validation habits and awareness of data sensitivity
  • Ability to review and validate AI-assisted outputs (e.g., model/design summaries or operational checklists) before use, escalating when uncertain and following data handling requirements
  • Experienced programming skills with Python, PySpark
  • Experience across the data lifecycle, building Data frameworks, working with Data lakes
  • Experience with Batch and Real time Data processing with Spark or Flink and Batch and Real time feature engineering with Spark or Flink or data brick
  • Working knowledge of AWS Glue and EMR usage for Data processing and real time data processing and features using Flink or Data brick live tables or Spark streaming
  • Experience working with Databricks and data brick live tables
  • Experience working in building services using Glue, Lamida, EMR or Flask, and deploying them on AWS EKS or Kubernetes
  • Working experience with both relational and NoSQL databases
  • Experience in ETL data pipelines both batch and real-time data processing, Data warehousing, NoSQL DB
 
Preferred qualifications, capabilities, and skills
 
  • Expertise in Amazon Web Services (AWS), Docker, and Kubernetes for cloud-native and containerized data solutions
  • Experience in big data technologies: Hadoop, Spark, Kafka, Flink
  • Experience in distributed system design and development

About JP Morgan Chase & Co.

JP Morgan Chase & Co. stands at the forefront of the global financial services industry. They offer an expansive array of products and services to a diverse clientele, including individuals, corporations, governments, and institutions. Ever since the merger of J.P. Morgan & Co. and Chase Manhattan Corporation in 2000, this industry-leading entity has become renowned for its comprehensive portfolio encompassing consumer and community banking, corporate and investment banking, commercial banking, as well as asset and wealth management. Headquartered in the vibrant city of New York, JP Morgan Chase & Co. boasts a formidable presence across over 100 countries worldwide.

Unveiling Employment Opportunities at JP Morgan Chase & Co.

Vacancies and Hiring Initiatives

JP Morgan Chase & Co. is continuously on the lookout for talented individuals eager to contribute to its legacy of excellence. The company's recruitment efforts are geared towards identifying candidates with the right blend of skills and qualifications to drive forward its various business segments. Whether you are a seasoned professional or a recent graduate, JP Morgan Chase offers a plethora of job openings across multiple disciplines.

High-Demand Positions

Among the myriad of roles, certain positions stand out for their attractive compensation packages and career advancement prospects. Notably, high-paying jobs at JP Morgan Chase & Co. include Relationship Manager, Branch Manager, and Software Engineer. These roles are critical to the firm's operations and offer lucrative opportunities for those with the requisite expertise.

Navigating the Job Market at JP Morgan Chase & Co.

Leveraging Job Portals and Job Alerts

For job seekers aiming to tap into the opportunities at JP Morgan Chase, staying updated through job portals and subscribing to job alerts is crucial. These tools can provide timely information about job openings, job fairs, and recruitment events, enabling candidates to apply promptly and prepare adequately for interviews.

Preparing Your Job Application

Your job application, comprising your resume and cover letter, is your ticket to securing an interview at JP Morgan Chase. Highlight your qualifications, skills, and experiences that align with the job listing, ensuring you stand out in the competitive job market.

Acing the Interview

Preparation is key to succeeding in your interview with JP Morgan Chase. Familiarize yourself with the company's business segments, values, and recent achievements. Demonstrating how your background and aspirations match the company's goals can significantly increase your chances of employment. A World of Job Opportunites in the Financial Services Industry JP Morgan Chase & Co. offers a world of job opportunities for those seeking to make their mark in the financial services industry. With competitive salaries, comprehensive benefits, and endless possibilities for growth, positions at JP Morgan Chase are highly coveted. By staying informed through job sites, tailoring your applications, and preparing thoroughly for interviews, you can enhance your prospects of joining the esteemed ranks of JP Morgan Chase employees. Explore the job board, seize the job opportunities, and embark on a rewarding career journey with one of the world's leading financial institutions.
Learn more about JP Morgan Chase & Co.
Size
661 employees
Market Cap
$384.5 billion
Industry
Net Income
$29.1 billion
Founded
1823
5 Year Trend
+0.7%
Revenue
$261.5 million
NASDAQ

Similar Jobs

More Jobs at JP Morgan Chase & Co.

More Information Technology Jobs

Find similar Lead Data Engineer - Pipelines, Spark Streaming and Spark Offline jobs: