American Express

Sr Data Engineer II

American Express$130K — $160K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Design and operate large-scale distributed data platforms.
  • Strong experience with NoSQL technologies like Cassandra or Elasticsearch.
  • Experience with data processing technologies such as Apache Spark.
  • Strong programming skills in languages like Python or Java.
  • Experience in designing data pipelines and event-driven systems.
  • Understanding of distributed system principles like scalability and reliability.
  • Ability to solve complex engineering problems.

Responsibilities

  • Design and build scalable, resilient, low-latency data platforms for payment workloads.
  • Develop distributed data processing and real-time streaming pipelines.
  • Create AI-ready data architectures for machine learning and Generative AI use cases.
  • Implement emerging AI capabilities like Large Language Models (LLMs).
  • Develop microservices and event-driven architectures.
  • Drive adoption of cloud-native technologies including automation and observability.
  • Establish practices for data quality, security, and operational excellence.

Benefits

  • Competitive base salaries
  • Bonus incentives
  • 6% Company Match on retirement savings plan
  • Free financial coaching and support
  • Comprehensive medical, dental, vision, and life insurance
  • Flexible working model with hybrid or virtual arrangements
  • 20+ weeks paid parental leave for all parents
  • Free access to on-site wellness centers
  • Confidential counseling support through our Healthy Minds program
  • Career development and training opportunities
Full Job Description
Senior Data Engineer - AI & Intelligent Payment Platforms

Are you ready to help build the next generation of intelligent payment platforms?

American Express is making strategic investments in next-generation payment network products, data platforms, and AI-powered capabilities to support its global growth agenda.

The American Express Card Network operates as a highly distributed, near-real-time, low-latency platform designed for exceptional availability and resiliency-processing transactions around the world, 24 hours a day, 365 days a year.

As a Senior Data Engineer - AI & Intelligent Payment Platforms, you will help design, build, and evolve highly scalable, AI-ready data platforms that power critical payment capabilities and enable real-time intelligence, advanced analytics, machine learning, and Generative AI use cases.

You will work at the intersection of data engineering, distributed systems, cloud-native technologies, and AI, helping transform large-scale payment data into intelligent, secure, and reliable products and experiences.

Responsibilities

  • Design and build highly scalable, resilient, and low-latency data platforms supporting mission-critical payment workloads.
  • Develop distributed data processing and real-time streaming pipelines capable of handling high-volume transactional data.
  • Build AI-ready data architectures and pipelines that enable machine learning, Generative AI, and real-time intelligence use cases.
  • Explore and implement emerging AI capabilities, including Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), embeddings, vector search, and AI agents, where appropriate.
  • Design and develop microservices, APIs, and event-driven architectures using modern engineering practices.
  • Drive adoption of cloud-native technologies, containerization, orchestration, CI/CD, automation, and observability.
  • Establish engineering practices for performance, scalability, resiliency, security, data quality, and operational excellence.
  • Apply Responsible AI and data governance principles, including privacy, security, explainability, model evaluation, and appropriate controls.
  • Evaluate emerging technologies across AI, data, and distributed computing and translate them into practical solutions for payment platforms.
  • Provide technical leadership, mentor engineers, conduct design reviews, and contribute to engineering standards and best practices.
  • Partner with product, architecture, data science, and engineering teams to turn complex business opportunities into scalable technology solutions.


Qualifications

Minimum Qualifications
  • Experience designing, implementing, and operating large-scale distributed data platforms and systems.
  • Strong experience with NoSQL technologies such as Cassandra, Elasticsearch, Couchbase, or Redis.
  • Experience with large-scale distributed data processing technologies such as Apache Spark.
  • Strong programming experience with Python, Java, Scala, or similar languages.
  • Experience designing data pipelines, data models, APIs, and event-driven architectures.
  • Strong understanding of distributed system concepts, including scalability, reliability, resiliency, security, and performance.
  • Demonstrated ability to solve complex engineering problems and deliver production-grade solutions.


Preferred Qualifications
  • Experience building AI/ML-ready data platforms supporting machine learning, Generative AI, or intelligent application use cases.
  • Familiarity with Generative AI, LLMs, RAG, embeddings, vector databases/search, and AI agent architectures.
  • Experience integrating AI/ML models and services into production environments.
  • Familiarity with MLOps/LLMOps, including deployment, evaluation, monitoring, observability, governance, and lifecycle management.
  • Experience with distributed messaging and streaming platforms such as Apache Kafka.
  • Experience with real-time distributed processing using technologies such as Spark, Kafka, Cassandra, and Elasticsearch.
  • Experience developing microservices and cloud-native applications.
  • Experience with Docker, Kubernetes, OpenShift, or similar container platforms.
  • Experience with CI/CD, DevOps, infrastructure automation, and production observability.
  • Understanding of Responsible AI, data privacy, security, governance, and model risk considerations.
  • Experience architecting large-scale systems with an emphasis on availability, scalability, performance, resiliency, and cost efficiency.
  • Ability to stay current with emerging AI and data engineering technologies and identify opportunities to apply them to real-world business problems.
  • Strong communication, collaboration, and technical leadership skills, with the ability to mentor engineers and influence technical direction.


Depending on factors such as business unit requirements, the nature of the position, cost and applicable laws, American Express may provide visa sponsorship for certain positions.

About the Team

We back you with benefits that support your holistic well-being so you can be and deliver your best. This means caring for you and your loved ones' physical, financial, and mental health, as well as providing the flexibility you need to thrive personally and professionally:

  • Competitive base salaries
  • Bonus incentives
  • 6% Company Match on retirement savings plan
  • Free financial coaching and financial well-being support
  • Comprehensive medical, dental, vision, life insurance, and disability benefits
  • Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need
  • 20+ weeks paid parental leave for all parents, regardless of gender, offered for pregnancy, adoption or surrogacy
  • Free access to global on-site wellness centers staffed with nurses and doctors (depending on location)
  • Free and confidential counseling support through our Healthy Minds program
  • Career development and training opportunities

For a full list of Team Amex benefits, visit our Colleague Benefits Site.

The below represents the expected salary range for this job requisition. Ultimately, in determining your pay, we'll consider your location, experience, and other job-related factors.

About American Express

Amex provides industrial services to the coatings and linings sector, providing support for commercial, industrial, and maritime projects such as petrochemical, power, and water treatment industries. They offer painting services for steel structures, storage tank linings and coatings, pipelines, floors, and marine vessels such as ships, tugboats, and barges.

American Express Careers

Join the vibrant team at American Express, a global leader in financial services, and be part of a company that values innovation, leadership, and diversity. At American Express, we offer more than just job opportunities; we provide a platform for professional growth and a chance to be part of a culture that is committed to excellence and inclusive growth. Work You’ll Do At American Express, we are dedicated to helping our employees reach their full potential. With a variety of career paths available in areas such as technology, marketing, finance, and customer service, American Express is the perfect place to advance your career. Our team is composed of highly skilled professionals who thrive on innovation and collaboration. Join our team and contribute to a company known for its prestigious history of leadership in the credit card industry. Engage in meaningful work that makes a real impact on our global scale business operations. American Express Leadership and Development Programs We believe in nurturing the leadership skills of our employees with extensive training programs and leadership development opportunities. Our commitment to professional growth is evident in our comprehensive benefits package that supports both personal and professional development. Internship Opportunities Start your career with an internship at American Express and gain valuable industry experience. Our internships offer a chance to develop skills, work on challenging projects, and learn from leaders in the industry. Interns at American Express are considered integral members of the team and are given responsibilities that provide a real insight into their future career paths. Diversity and Inclusion At American Express, diversity and inclusion are at the core of our company culture. We are committed to building a diverse workforce and inclusive environment where every employee feels valued and inspired. We offer diversity training programs that empower our employees to thrive and lead in a global marketplace. Networking and Innovation Our employees enjoy unparalleled opportunities for networking and personal growth through our global connections and innovative projects. American Express encourages a culture of innovation that helps propel our company and your career forward. Career Benefits and Growth American Express is dedicated to the growth of its employees. We offer competitive benefits, including health, retirement plans, and family leave, ensuring that our team members have the support they need to succeed both at work and in their personal lives. Join Our Team Explore the job opportunities and open positions at American Express. We are continuously hiring talented individuals who are passionate about their careers and interested in working for a company that offers a dynamic and supportive environment. Stay Connected Keep up to date with the latest from American Express Careers by following our career blog and signing up for job alert emails. Tailor your subscription to receive updates that match your skills and interests. Discover the exciting and rewarding career opportunities that await at American Express. SEARCH AMERICAN EXPRESS JOBS Whether you are looking for a full-time position, an internship, or a leadership opportunity, American Express offers a path to a rewarding career. Join us and make a difference with your passion, creativity, and drive.
Learn more about American Express
Size
64,000 employees
Market Cap
$108.1 billion
Industry
Net Income
$3.1 billion
Founded
1850
5 Year Trend
+3.5%
Revenue
$37 billion
NASDAQ

Similar Jobs

More Jobs at American Express

More Information Technology Jobs

Find similar Sr Data Engineer II jobs: