Bank of America Corporation

Senior Data Engineer

Bank of America Corporation$120K — $145K *
Finance & Insurance
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 12+ years of experience with Data Engineering
  • Hands-on experience in Scala, Spark, Kafka Streaming
  • Strong knowledge of Hadoop components, Informatica, and cloud technologies
  • Experience in designing and implementing cloud-native data platforms
  • Proficiency in performance tuning and UNIX Shell Scripting
  • Familiarity with large-scale analytical platforms and distributed data processing frameworks

Responsibilities

  • Assemble and clean large, complex data sets to meet business requirements
  • Maintain and enhance operational and analytics data systems for data quality
  • Design and develop data pipelines for informed decision-making
  • Contribute to testing processes and lead issue identification
  • Identify gaps in data management standards and develop corrective plans
  • Mentor Data Engineers for continuous integration and delivery initiatives

Benefits

  • Opportunities for professional development and upskilling
  • Mentorship from experienced leaders in the field
  • Exposure to a variety of cloud technologies and data solutions
  • Ability to work on innovative projects in a supportive environment
  • Flexibility in working with global teams across different time zones
Full Job Description
Job Description:

This job is responsible for driving data engineering efforts to deliver enterprise-wide capabilities and complex data solutions. Key responsibilities include directing code design and delivery tasks associated with the integration, cleaning, transformation, and control of data in operational and analytical data systems and working with the Project Management team to define outcomes and inform work structures. Job expectations include providing technical thought leadership by implementing complex data solutions and interactions across multiple systems and domains.

Overview:
  • Lead requirement analysis, high-level and low-level design, development, and implementation of enterprise-scale data platforms and integration solutions leveraging Spark/Scala, Kafka, Hadoop, Starburst, Cloud technologies, Object Storage, and Informatica.
  • Lead developer experience with ability to conduct design reviews, mentor / coach development teams, and produce comprehensive yet flexible solution designs.
  • Ensures that the design and engineering approach for complex features are consistent with the larger portfolio solution
  • Key experience developing and delivering complex software requirements to accomplish business goals
  • Capability to ensure software is developed to meet functional, non-functional, and compliance requirements
  • Successful background ensuring solutions can be integrated successfully into the overall application/system with clear, robust and well-tested interfaces
  • Should be able to lead multiple projects concurrently each with competing deadlines.
  • Should be knowledgeable in Treasury Payments and Deposits domains.
  • Serves as a fully seasoned/proficient technical resource; provides technical knowledge and capabilities as team member and individual contributor.
  • Typically 10 or more years of data delivery/integration experience
  • Works under minimal supervision
  • Has the knowledge of Hadoop Spark/Spark Streaming best practices and standards as well as standard software development lifecycle experience.
  • Must have an understanding of our ability to quickly grasp technology concepts
  • Solid quantitative, analytical, process development, facilitation skills, and organizational skills required
  • Strong communication, presentation, interpersonal, software development and work management skills are essential
  • Coordinate with deployment and support teams and ensure projects are successfully deployed into testing and Production environments.
  • Development experience using Agile process
  • Experience in designing, developing and deploying Real time and Near real time & batch data integration solutions
  • Work with people in different time zones & teams


Responsibilities:
  • Assembles large, complex data sets that meet functional and non-functional requirements, ensuring that the design and engineering approach is consistent across multiple systems
  • Maintains, improves, cleans, and manipulates large data for operational and analytics data systems, builds complex processes supporting data transformation, data structures, metadata, data quality controls, dependency, and workload management, and communicates required information for deployment, maintenance, and support of business functionality
  • Utilizes multiple architectural components in the design and development of client requirements and collaborates with development teams to understand data requirements and ensure the data architecture is feasible to implement
  • Defines and builds data pipelines to enable data-informed decision making, ensuring adherence to release processes and risk management routines
  • Contributes to existing test suites including integration, regression, and performance, analyzes test reports, identifies any test issues and errors, and leads triage of underlying causes
  • Leads the identification of gaps in data management standards adherence and works with appropriate partners to develop plans to close gaps, leading concept testing and conducting research to prototype toolsets and improve existing processes
  • Mentors Data Engineers in the delivery and release of continuous integration and continuous delivery events and defines key performance indicators and internal controls


Required Qualifications:
  • 12+ years of experience with Data Engineering
  • Experience with large-scale analytical platforms, metadata-driven architectures, and distributed data processing frameworks is preferred.
  • Design and implement cloud-native data platforms utilizing Object Storage, Data Lakehouse architecture, distributed query engines, and streaming technologies to support real-time, near real-time, and batch processing requirements.
  • Hands on experience in Scala, Spark, Kafka Streaming
  • Very good understanding of Hadoop components, architecture & tool sets: Spark and Scala, Informatica, Starburst, Object Storage in enterprise data platforms
  • Must have Architected, developed & implemented solutions using real time streaming technologies
  • Good knowledge of performance tuning
  • Experience working with Exadata & Oracle SQL Tuning
  • Experience working with Starburst and Object Storage
  • Experience developing Streaming/Near Real time and Batch data integration solutions.
  • Hands on experience in UNIX Shell Scripting
  • Working experience with scheduling tools


Desired Qualifications:
  • CICD Build & Deployment tools
  • API development experience
  • Financial Services / Banking experience
  • Experience in distributed computing
  • Experience with open table formats such as Apache Iceberg, Delta Lake, or equivalent technologies
  • Experience with enterprise metadata management, data lineage, governance, and data quality frameworks


Skills:
  • Analytical Thinking
  • Application Development
  • Data Management
  • Risk Management
  • Solution Design
  • Agile Practices
  • Architecture
  • Collaboration
  • Decision Making
  • DevOps Practices
  • Business Acumen
  • Data Quality Management
  • Financial Management
  • Solution Delivery Process
  • Test Engineering


Shift:
1st shift (United States of America)

Hours Per Week:
40

About Bank of America Corporation

Bank of America Merrill Lynch is the corporate and investment banking division of Bank of America. It provides services in mergers and acquisitions, equity and debt capital markets, lending, trading, risk management, research, and liquidity and payments management. It was formed through the combination of the corporate and investment banking activities of Bank of America and Merrill Lynch following the acquisition of the latter by the former in January 2009. Bank of America completed the acquisition of Merrill Lynch & Co on 1 January 2009. Bank of America began rebranding all of its corporate and investment banking activities under the Bank of America Merrill Lynch name in September 2009. In April 2010, Bank of America Merrill Lynch appointed Christian Meissner as head of investment banking for Europe, Middle East and Africa. In April 2011, Bank of America Merrill Lynch integrated its corporate and investment banking operations into a single division. In October 2013, Bank of America Merrill Lynch was recognised as the Most Innovative Investment Bank of the Year in The Banker's Investment Banking Awards.

Bank of America Corporation Careers

Join the dynamic team at Bank of America Corporation, a premier global financial institution where innovation, leadership, and growth go hand in hand. As one of the largest banks in the world, we offer unparalleled job opportunities and a culture that values diversity, inclusion, and professional growth. Work You’ll Do At Bank of America Corporation, you’ll be part of a team that’s dedicated to making a real difference. Whether you’re helping families buy their first home, advising businesses on expansion, or developing cutting-edge financial technologies, your work will have an impact. Our commitment to leadership in the financial industry has never been stronger, and we need passionate, skilled professionals to lead our journey. Explore a World of Opportunities From entry-level positions to leadership roles, Bank of America Corporation offers a variety of career paths in areas such as investment banking, technology, marketing, and risk management. Our job opportunities span the globe, providing the chance to work alongside the best in the industry and develop skills that will propel your career forward. Internship Programs Kickstart your career with Bank of America Corporation’s internship programs. These opportunities provide hands-on experience and a chance to engage in meaningful work that complements your academic studies. Interns gain invaluable networking opportunities, receive mentorship from seasoned professionals, and learn about the culture and operations of a global financial leader. Benefits and Growth Bank of America Corporation is committed to the well-being and continuous professional development of our team members. We offer a competitive benefits package that supports the health, financial stability, and work-life balance of our employees. Our training programs and development initiatives ensure that every team member has the opportunity to grow and advance within the company. Inclusive Culture We believe our strength lies in our diversity. Bank of America Corporation fosters an inclusive environment where all employees can thrive. Through diversity training and a commitment to equal opportunities, we cultivate leadership and innovation that reflect the wide-ranging communities we serve. Join Our Team Are you ready to advance your career at a company that’s at the forefront of the financial industry? Explore the positions available at Bank of America Corporation and find where your skills and interests align with our needs. We are continuously hiring and looking for individuals who are curious, creative, and eager to drive change. Stay Connected Keep up to date with the latest from Bank of America Corporation Careers by subscribing to our job alert emails. Tailor your subscription to receive updates that match your career interests and get insider tips that can help you during your application and interview process. Bank of America Corporation is not just a company—it’s a place where you can shape your future and the future of finance. Join us and be part of a team that’s redefining what a bank can be.
Learn more about Bank of America Corporation
Size
208,000 employees
Market Cap
$260.3 billion
Industry
Net Income
$17.8 billion
Founded
1998
5 Year Trend
-1.4%
NASDAQ

Similar Jobs

More Jobs at Bank of America Corporation

More Finance & Insurance Jobs

Find similar Senior Data Engineer jobs: