Data Engineer

Salary depends on experience
Posted on 03/17/18 by Tim Martin
Confidential Company
Mc Lean, VA
Staffing & Recruiting
Salary depends on experience
Posted on 03/17/18 Tim Martin

Role: Data Engineer

Location: McLean, VA

Interview Process: F2F preferred, Skype okay for Non Locals.

 

Notes: LOB: HR, Data Mgmt.

Project: Maintaining data in cloud ecosystem, building data pipeline

Requirement

  1. AWS exposure, including S3 and Redshift
  2. ETL tool expertise (Ab Initio preferred but will take any. They are using Hydrograph but manager doesn?t expect anyone out there to really have this)
  3. Java, Scala, Python. Comfortable with programming languages.
  4. Familiarity with GitHub.

 Nice to have

  1. Spark (conducting data transformation on this framework)
  2. Exposure to DevOps, esp. Jenkins (?would be extremely helpful?)
  • Day to day: develop data pipeline from beginning to end, break data into stories. Use AWS to consume/transform data. Some data resources require a lot of transformation, others require little. Leverage java to extend functionality of ETL tools. Work is more on ETL than Java.
  • Developed/deployed a data pipeline on AWS 

Not the right job?
Join Ladders to find it.
With a free Ladders account, you can find the best jobs for you and be found by over 20,0000 recruiters.