Bachelor's degree or equivalent with 10+ years in cloud infrastructure design and operation
5+ years experience in Amazon AWS solutions
5+ years in a DevOps and/or SRE role
Experience with chaos engineering at scale
Proficient in multiple programming languages (e.g., Python, Java, GO)
Strong database development skills (SQL Server, PostgreSQL, MySQL)
Experience with Service Level Objectives (SLOs) and Error Budgets
Responsibilities
Design technology solutions to minimize service disruptions
Recommend and automate solutions to prevent technology failures
Foster a culture of blameless post-mortems for reliability improvement
Transform operations teams to adopt SRE best practices
Analyze incidents for trends impacting technology availability
Drive initiatives to reduce technology failures in distributed environments
Integrate information from various systems for cohesive technology insights
Benefits
Opportunity to lead and shape SRE practices within a global technology framework
Engagement with cutting-edge observability and automation tools
Collaborative environment fostering deep learning and innovation
Potential for professional development and mentorship opportunities
Flexible work arrangements including on-call responsibilities
Full Job Description
In this role as Principal Site Reliability Engineer, Infrastructure Observability you will help formulate, develop, and implement a team of Site Reliability Engineers (SREs) focused on the observability, sustainability, scalability, measurability and recoverability of our Partner's innovative cloud and on-prem solutions by leveraging automation and best-of-breed tools. The successful candidate will have a strong operations & engineering background, is hands-on when needed, and has expertise in the cloud environments (public, private), infrastructure operations, DevOps practices, CI/CD toolchain and systems, code build and deployment, incident response, and 24x7 monitoring and support.
The candidate will also have extensive experience operating within a SRE function within a complex, distributed environment. They will have a demonstrated ability to work horizontally and vertically within an organization with diverse partners and sponsor groups.
Responsibilities
Possess extensive knowledge in own area of expertise and extensive in-depth knowledge of the broader portfolio for comprehensive understanding of up/downstream impacts across technology infrastructure
Responsibility for the design of technology solutions to prevent or minimize service disruptions
Prevent technology service disruptions through technology solution recommendations and automations
Foster a culture of deep learning through blameless post-mortems to improve the shared goal of reliability across services
Transform operations teams by facilitating internal change to adopt SRE standard methodologies across the organization and driving strategic growth in this area within Global Technology
Analyze incidents impacting technology availability for high-level trends across the broad portfolio
Drive initiatives to reduce or prevent technology failures in a complex, distributed technology environment
Pull together information from disconnected systems into cohesive views of the technology portfolio for identifying trends, redundancies, and risk
Demonstrate outstanding awareness of the complexities of the tech and asset management industries
May lead initiatives of varying degrees of complexity that span multi-functional areas and of varying degrees of complexity
Contribute to definition of target state architecture and design of the technology environment
Requirements
US Citizenship
Bachelor's degree or the equivalent combination of education and relevant experience AND 10+ years of experience designing and operating cloud infrastructure with seniorlevel impact
5+ years building and supporting solutions in Amazon AWS
5+ years of experience building and running a DevOps and/or SRE function
Experience with implementation and operation of the chaos model at scale
Strategic and program-level implementation experience
Demonstrable experience implementing new technology, tools, and platforms System administration and scripting experience
Demonstrable experience leveraging automation to proactively prevent or quickly remediate incidents
Fluent in multiple programming languages (e.g., Python, Java, GO, Node.js, .Net Core, etc.)
Proficiency with database development (SQL Server, PostgreSQL, MySQL, etc.)
Proficiency with defining, right-sizing, tracking, and reporting on Service Level Objectives (SLOs), Service Level Indicators (SLIs), system availability, and the progress and outcomes related to reliability
Experience with implementing and managing Error Budgets
Proficiency with understanding and explaining incident situations and their recovery plans to prevent recurrence
Knowledge/experience driving dashboard standardization across the ecosystem for observability, APM and infrastructure monitoring, and application-specific logging
Knowledge/experience with observability tools such as New Relic, SolarWinds DPA, Elastic Stack, Prometheus, Grafana, Splunk, and cloud native tools
Knowledge/experience with cloud management tools such as Ansible, Terraform, Vault, and Vagrant
Works independently, with guidance in only the most complex situations
Makes sound decisions with limited facts or resources
Balances strategic and pragmatic concerns when solving problems
Adjusts communication style and materials to suit a given audience
Able to clearly articulate operational principles, practices, and policies
Stays abreast of industry trends and technologies
Accountable for work of self and others; sets standards around which others will operate
Maintains a broad internal professional network and knows when to engage/activate it
Develops or mentor's diverse talent on the team
Ability to be on-call and/or work during off-hours
