Big Data Systems Administrator

Economical Insurance   •  

Toronto, ON

Industry: Accounting, Finance & Insurance


8 - 10 years

Posted 30 days ago

This job is no longer available.

In this role, you will:

  • Support Big Data system environments such as:Cloudera CDH, Hortonworks.

  • Provide technical expertise and direction to projects, releases and support teams to effectively deliver quality solutions and services and implement, support and maintain a stable and scalable technology portfolio aligned with business goals and enterprise and IT standards.

  • Be accountable for the overall quality of the technical solutions, working collaboratively with stakeholders across business and technology teams seeking opportunities to improve quality of service and demonstrate commitment to operational excellence for all deliverables.

  • Coordinate day-to-day team efforts and priorities and ensures alignment with management direction and decisions and works with the team on continuous improvement efforts focused on process, standards and tools within the function.

Your Responsibilities

  • Provide technical direction and coaching to the team in a technical lead capacity for the specific area of technical expertise, without formal people management accountabilities

  • Provide technical direction to a project or services team, prepares, reviews and recommends solutions and is accountable for the overall solution, support activity or service

  • Collaborate with team members across technology to ensure the overall solution includes requirements based on business requirements and technology standards, processes and policies

  • Plan and prioritize tasks for the working team to ensure effective and efficient delivery of service for the technical area of accountability and ensure adequate resource coverage to meet business demands

  • Participate in governance forums required for the technical area of specialty and ensure follow-up items are completed in alignment with the target data and business priority

  • Validate completeness and accuracy of requirements for each area of delivery and confirm outcomes have met the requirements

  • Act as an expert resource providing insight and recommendations based on industry and technology trends, technology strategy and experience and share direction and learnings with team members

  • Assess risk during projects and on a daily basis for the specific area of technical expertise based on the complexity, maturity of the technology, experience of the team members and criticality of the solution to the business; identify and execute risk mitigation plans

  • Build relationships with business and IT partners across all teams and work collaboratively to identify solutions and resolve any variances from stated business objectives

Your Skills and Experience

  • Undergraduate degree in Computer Science or a related discipline.

  • 7+ Years of Linux/Unix System Administration experience

  • Demonstrated experience in system performance management techniques and performance-related system level tuning.

  • Previous experience with shell scripting, such as bash, awk, sed.

  • Good knowledge of Python and Perl.

  • Knowledge of Active Directory, LDAP, Kerberos, Group Policy administration, role based access security management.

  • Extensive experience with different software version control systems, e.g. GIT, CVS. Knowledge of DevOps, Continuous Integration (CI), Continuous Deployment (CD) pipeline and tools like Jenkins, GIT, Artifactory.

  • 2-3 years of experience with the following is very advantageous:

    • Experience supporting Big Data system environments, such as Cloudera CDH, Hortonworks.
    • Understanding and experience with Hadoop Stack including HDFS, Hive, HBase, Yarn, Flume, Scoop, Oozie, Impala, Spark.
    • Experience with Hadoop Cluster installation, configuration, cluster monitoring and troubleshooting.
    • Experience with Hadoop security, cluster resources management, cluster maintenance.
    • Experience with public Cloud environments including AWS and Azure. Experience in build and deployment automation using Ant, Shell Scripts, etc