PROJECT SUMMARY:
This role provides hands-on leadership and governance oversight for outsourced performance testing teams working across multiple delivery channels on concurrent projects. Candidate is expected to provide input for the long-term strategy and roadmap for the Performance Testing CoE and work with internal support teams to drive optimization of key business applications.
RESPONSIBILITIES:
- Participates in the review of existing process, techniques, test methodologies, design, approach, and strategy for continuous improvement
- Participates in the assessment of new performance test tools to determine fit in the environment
- Creates, monitors, and tracks software QA metrics specific to performance testing
- Writes, revises, verifies, and enforces performance testing standards
- Facilitates performance defect triage, analyzing performance metrics and logs to determine the root cause of issues
- Determines when performance testing is mandatory by performing project artifact reviews and through discussions with the project teams
- Collaborates with project managers to develop schedules and resource allocation models for performance test engagements
- Communicates performance test results in terms that can be easily understood and actioned by the business or project teams
- Provides support for performance testing activities for large projects, small enhancements, and infrastructure upgrades
- Provides input to performance testing contracts and estimates based on fixed cost outsourcing model
- Reviews testing deliverables including the performance test plan, test scripts, test scenarios, test results, and final reports produced by suppliers for quality and adherence to QA standards
- Mentors, coaches, and monitors junior QA team members
QualificationsSKILLS REQUIRED:
- 10+ years' experience in performance testing and engineering
- Hands-on ability to plan, script, and execute performance tests based on requirements
- Hands-on ability to interpret and analyze performance test results
- Hands-on experience with APM and monitoring tools; ability to identify performance issues or bottlenecks and provide recommendations to tune systems for optimal performance
- Must possess a strong knowledge of enterprise application architecture and technologies including web, web services, databases, middleware and messaging
- Expert level experience with HP Performance Center, VuGen, LR Analysis, and HP Diagnostics or other APM tools
- Experience performance testing of UI based applications, web services, middleware, and batch processes
- Expertise of monitoring solutions and KPI's used to determine when there are performance issues or concerns across technology stacks
- Must be able to create and validate load test scripts in at least three of the following protocols: HTTP, SOAP / web services, TruClient, ODBC, RTE, Visual Basic, .NET, Java
- Must be able to perform in-depth analysis of load tests both in real-time during test execution and post run to determine test validity, discover the root-cause of any errors or failures, and report on any performance issues or defects
- Experience managing performance testing in an Agile development environment
- Must demonstrate or possess strong experience in:
- Excellent verbal and written communication skills
- Reviewing test artifacts and deliverables to provide feedback and direction
- Assessing risk to schedule, cost, or quality on projects and testing engagements
- Preparing and facilitating the implementation of test plans
- Managing defects
- Ability to react to changing project plans and come up with creative alternatives
- Organizational and planning skills
- Analytical skills
- Ability to work in a collaborative "team-oriented" environment
Additional InformationSKILLS DESIRED:
- Experience with performance testing and monitoring tools outside of HP products
- Should possess an understanding of software development and implementation methodologies including both waterfall and Agile
- Development / code review / code profiling / performance engineering background
- DevOps / continuous integration experience
- Hands-on experience in the following technologies:
- Windows 2012 Server, Red Hat Linux.
- J2EE Application Servers, .NET, SFDC, Siebel, SAP, TIBCO
- Database: Oracle, MS SQL
