Sr. Data Engineer

Capital One Financial   •  

Mc Lean, VA

Industry: Accounting, Finance & Insurance


Less than 5 years

Posted 175 days ago

This job is no longer available.

Sr. Data Engineer

The Role: We are looking for driven individuals to join our team of passionate data engineers in creating Capital One’s next generation of data products and capabilities.

- You will build data pipeline frameworks to automate high-volume and real-time data delivery for our Hadoop and streaming data hub

- You will build data APIs and data delivery services that support critical operational and analytical applications for our internal business operations, customers and partners

- You will transform complex analytical models into scalable, production-ready solutions

- You will continuously integrate and ship code into our on premise and cloud Production environments

- You will develop applications from ground up using a modern technology stack such as Scala, Spark, Postgres, Angular JS, and NoSQL

- You will work directly with Product Owners and customers to deliver data products in a collaborative and agile environment

Basic Qualifications:

- Bachelor’s Degree or military experience

- At least 3 years in coding in data management, data warehousing or unstructured data environments

- At least 3 years experience with leading big data technologies like Cassandra, Accumulo, HBase, Spark, Hadoop, HDFS, AVRO, MongoDB, Zookeeper

Preferred Qualifications:

- Master's Degree

- 3+ years experience with Agile engineering practices

- 3+ years in-depth experience with the Hadoop stack (MapReduce, Pig, Hive, Hbase)

- 3+ years experience with NoSQL implementation (Mongo, Cassandra, etc. a plus)

- 3+ years experience developing Java based software solutions

- 3+ years experience in at least one scripting language (Python, Perl, JavaScript, Shell)

- 3+ years experience developing software solutions to solve complex business problems

- 3+ years experience with Relational Database Systems and SQL

- 3+ years experience designing, developing, and implementing ETL - 3+ years experience with UNIX/Linux including basic commands and shell scripting

Job ID R49268