Data Science Infrastructure Engineer

 •  Open Systems Technologies New York, NY

Staffing & Recruiting

Salary depends on experience
Posted on 09/20/17 by Radhika Arora
Staffing & Recruiting
Salary depends on experience
Posted on 09/20/17 by Radhika Arora

The chosen candidate will help build a next generation Data Science platform.

Responsibilities

  • Interact with data scientists to understand their workflows and requirements
  • Design and deploy solutions for problems such as high availability, elastic load distribution, and high throughput
  • Automate operation, installation, and monitoring of data science ecosystem components in our infrastructure stack
  •  Troubleshoot and debug run-time issues
  •  Provide developer and operational documentation
  •  Provide performance analysis and capacity planning for clusters
  •  Identify and perform OS and hardware-level optimizations

Qualifications

  •  Experience programming in Python, Java, Scala, JavaScript, or Ruby
  •  Linux systems administration experience (Bash, Network, Filesystems)
  •  Experience with configuration management systems (Chef, Puppet, Ansible, or Salt)
  •  Experience with continuous integration tools and technologies (Jenkins, Git, Chat-ops)
  • (Desired) Experience building and scaling Docker based systems using Kubernetes, Swarm, Rancher, Mesos
  • (Desired) Experience configuring, deploying, managing Apache Spark, and Hadoop HDFS
Not the right job?
Join Ladders to find it.
With a free Ladders account, you can find the best jobs for you and be found by over 20,0000 recruiters.