Lead Data Platform Engineer in Deerfield, IL

View All Finance & Insurance jobs

Industry:

Finance & Insurance   •  

5 - 7 years

Posted 8 weeks ago

Job Description

At Discover, be part of a culture where diversity, teamwork and collaboration reign. Join a company that is just as employee-focused as it is on its customers and is consistently awarded for both. We're all about people, and our employees are why Discover is a great place to work. Be the reason we help millions of consumers build a brighter financial future and achieve yours along the way with a rewarding career.

We are seeking bright, talented and driven engineers to join a team of passionate and innovative technologists. In this role, you will experience hands on engineering and administration experience on Discovers next generation platforms supporting the most critical payments applications for all of Discover network brands.

You will be empowered (yes, empowered) to apply software engineering techniques and discipline to production operations and help us deliver the world's greatest solutions. You will provide feedback into the architecture and application design for each next generation of Payment Services development. If you are the type of person that loves driving technology problem solving sessions; has a tireless passion to increase the performance, resiliency and availability of IT solutions serving the greatest Customers and Partners in the World.

To be successful (and we know you can be), you will need to have a strong IT understanding with work experience in off- and on-premise cloud based and virtual system infrastructure and peripheral services including network, firewall, and database management. We also need you to understand the application development and quality assurance ends of the spectrum as you will need to interface with that crew as well. During problem escalations you are the driver of the team that finds the root cause, restores functionality, and proposes the long term solution.

Sounds awesome doesn't it? We think so but we ultimately need you to make this a reality. You will be exposed to the latest technologies in the Industry while helping us create the next generation of Payment Service solutions. It's all cutting edge and you have the opportunity to be right in the middle of it. If you're motivated by leading your work vs. following a checklist, enjoy advocating for and driving change as well as inventing features or projects that solve a business challenge. Join our team.

Responsibilities:

Contributing member of a high performing engineering and administration team over Critical Hadoop Application clusters.

Provide technical expertise to design efficient engineering solutions for next generation platforms which include the following technologies: (Kafka, Storm, Spark, Solr, Zookeeper, NiFi, HBase, HDFS, HIVE, YARN, Ranger, Knox, Ambari and Kerberos)

Big Data Cluster platform provisioning-administration

Big Data Cluster Resiliency and Performance engineering and administration

Big Data Cluster Security Implementations

Big Data engineering and administration for high availability, replications and disaster recovery solutions

Big Data database engineering and administration

Leverage DevOps techniques and practices to include Continuous Integration, Continuous Deployment test build automation working with key application architects and application developers

Level 2/3 "go to" team for operational support

Develops and leads an Agile team focused on next-generation data and analytic technologies.

Provides technical consulting in support of the creation and enhancement of analytical platforms and tools.

Provides technical consulting to application development teams during application design and development for highly complex and critical data projects.

Partners on a team to deliver data projects, including migration to new data technologies for unstructured, streaming, and high-volume data.

Develops and deploys big data applications.

Builds and administers large scale data platforms. Integrates next-generation data analytic tools into the big data ecosystem.

Responsible for supporting the delivery of data-driven platforms and next-generation analytical technologies.

#LI-MF1

Minimum Qualifications

At a minimum, here's what we need from you:

Bachelor's Degree in Computer Science, or related field

2+ years of experience in Data Platform Administration, Engineering, or related field

In lieu of a degree, 6+ years of experience in Data Platform Administration, Engineering, or related field

Preferred Qualifications

If we had our say, we'd also look for:

4+ years' experience working with Hadoop Cluster Engineering and Administration

A level of hands-on experience working with Kafka, Storm, Spark, Solr, Zookeeper, NiFi, HBase, HDFS, HIVE, YARN, Ranger, Knox, Ambari and Kerberos

Experience leveraging DevOps techniques

4+ years of experience in Data Platform Administration, Engineering, or related field.