Staff Engineer - Cluster Management

Qubole   •  

Santa Clara, CA

Industry: Technology

  •  

Not Specified years

Posted 173 days ago

This job is no longer available.

What you'll be doing

    • Design, develop and debug complex software systems that are the underpinnings for Qubole’s big data engines
    • Architect and implement large-scale distributed systems that work reliably on all the public clouds (AWS, Azure, Oracle, GCP)
    • Build features that will require working across different layers of the Qubole stack
    • Hold a high bar for scale, performance and reliability of all your designs & code
    • Mentor junior engineers and ensure completeness of their design & code
    • Be a role model in the engineering organization based on your technical contributions, aptitude, and maturity

Required experiences and skills

    • Extensive development experience in one or more of Python, Java, Ruby, C/C++/C#.
    • Hands-on experience designing, building and debugging complex production systems on the cloud (AWS, Azure, GCP, Openstack) and/or deep in the guts of file systems, operating systems, database back-ends
    • Is the go-to engineer in the company for her/his areas of ownership
    • Effortlessly collaborates across teams and works across components for his features
    • Strong grasp over concurrency control, multi-threading and parallel processing
    • Has worked in agile software development cycles
    • Comfortable working with geographically distributed development teams
    • Bachelors degree in CS/Eng required, masters/ Ph.D. a plus
    • Deep understanding and hands-on experience with containers and/or their orchestration frameworks (Kubernetes, Mesos, Swarm)
    • Experience with big data technologies like Hadoop, Hive, Spark, etc a plus