Blue Shield Of California

Director, Performance Engineering and Test Automation

Blue Shield Of California$150K — $180K *
Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree or 4 additional years of relevant experience in lieu of a degree
  • 10 years of software engineering, quality engineering, or performance engineering experience
  • 6 years of leadership experience in performance and test automation
  • Hands-on background in building automated test systems and performance pipelines
  • Experience testing distributed systems, microservices, and cloud-native applications
  • Proficient with tools like k6, JMeter, Grafana, and others
  • Strong understanding of Kubernetes, cloud infrastructure, and performance metrics

Responsibilities

  • Build the performance engineering and automated testing function for cloud-native platform
  • Design and implement automated performance and load testing systems
  • Establish automated quality gates in CI/CD for early feedback
  • Define performance expectations and testing standards
  • Collaborate with developers on testing microservices and workflows
  • Utilize AI-assisted tools to enhance testing and analysis
  • Create realistic test environments and strategies reflecting real workflows
  • Develop dashboards for performance trends and actionable insights

Benefits

  • Hybrid work model allowing for in-office and remote flexibility
  • Opportunity to build and lead a high-leverage team over time
  • Engagement with innovative technologies like AI-assisted engineering tools
  • Exposure to a cloud-native architecture and agile development practices
  • Hands-on mentorship and leadership opportunities in a technical domain
Full Job Description
Job Description

Your Role

The Stellarus Technology team builds and operates the platform, services, and products that support payer operations, member experiences, customer integrations, and internal product delivery. The Director, Performance Engineering and Test Automation will report to the VP, Engineering. In this role, you will create the automated performance and reliability validation systems that give engineering teams clear evidence before services reach production.

You will own the strategy and implementation for performance testing, load testing, scalability validation, resilience testing, synthetic monitoring, test data automation, and release gates across the Stellarus platform. You will work directly with developers to define the standards, patterns, tooling, and expectations teams use when they design, build, test, and operate services, including where AI and AI-assisted engineering tools can improve quality, speed, and signal.

This is a new role for a builder who can define the practice, implement the tooling, partner with engineering teams, and create a culture where performance and reliability are validated continuously. The role combines performance engineering, platform quality, automation, observability, and production readiness.

Responsibilities

Your Work

In this role, you will:
  • Build the performance engineering and automated testing function for Stellarus' cloud-native platform.
  • Design and implement fully automated performance, load, stress, soak, regression, and scalability test systems for services, APIs, workflows, and products.
  • Establish automated quality gates in CI/CD so teams get clear feedback before code reaches production-like environments.
  • Define service-level performance expectations, test coverage standards, baseline thresholds, release criteria, and escalation paths for performance regressions.
  • Partner directly with developers to define practical standards for testing microservices, event-driven workflows, APIs, customer-facing applications, and internal platform services.
  • Use AI-assisted tools where they make sense to accelerate test generation, synthetic scenario creation, log analysis, regression detection, documentation, and developer feedback loops.
  • Create production-like test environments, test data strategies, traffic models, synthetic workloads, and repeatable test scenarios that reflect real healthcare payer workflows.
  • Use observability data to connect test results to system behavior, including latency, throughput, error rates, queue depth, resource saturation, database performance, cold starts, retries, and downstream failures.
  • Help teams identify bottlenecks in application code, APIs, database queries, infrastructure, Kubernetes configuration, service-to-service calls, and event processing.
  • Build dashboards and reporting that make performance trends visible and actionable for engineers, product leaders, and technology leadership.
  • Collaborate with developers to define standards for automated end-to-end testing, contract testing, integration testing, and performance regression testing across the Nx monorepo.
  • Work with platform engineering to integrate testing into GitHub Actions, AKS, Dapr, Azure Service Bus, APIM, Terraform-managed environments, and ArgoCD deployment workflows.
  • Lead incident and launch readiness reviews where performance, scalability, or reliability risk is material.
  • Mentor developers, architects, and managers on performance design, test automation, failure analysis, and production readiness.
  • Build a small high-leverage team over time, while remaining close enough to the tooling and technical details to set direction credibly.


Qualifications

Your Knowledge and Experience
  • Bachelor's degree or High School Diploma/GED and 4 years of additional relevant experience in lieu of a degree.
  • 10 years of software engineering, quality engineering, performance engineering, platform engineering, SRE, or related technical experience.
  • 6 years leading teams or technical programs focused on performance, test automation, reliability, platform quality, or production readiness.
  • Strong hands-on background building automated test systems, load testing frameworks, performance pipelines, or reliability validation tooling.
  • Experience testing distributed systems, microservices, APIs, event-driven architectures, and cloud-native applications.
  • Practical understanding of latency, throughput, concurrency, queueing, backpressure, retries, caching, database performance, resource saturation, and failure modes in production systems.
  • Experience with tools such as k6, Gatling, JMeter, Locust, Playwright, Cypress, Jest, Grafana, Prometheus, OpenTelemetry, Datadog, New Relic, Azure Monitor, or similar platforms.
  • Experience integrating automated tests into CI/CD pipelines and making test results useful to engineering teams.
  • Experience evaluating or applying AI-assisted engineering tools for test generation, analysis, automation, or developer productivity is preferred.
  • Strong understanding of Kubernetes, containers, cloud infrastructure, API gateways, message queues, relational databases, and service observability.
  • Ability to work with engineers at code, architecture, infrastructure, and operational levels.
  • Experience defining performance benchmarks, synthetic workloads, test data strategies, production-like environments, and release readiness criteria.
  • Strong communication skills. You can explain performance risk clearly and turn findings into practical engineering action.
  • Healthcare, payer, regulated-industry, SOC 2, HIPAA, or security-sensitive platform experience is preferred.


Technology Context

Stellarus is building primarily with:
  • TypeScript, Node.js, NestJS, React, Next.js
  • PostgreSQL, Azure Blob Storage, Snowflake
  • Azure Kubernetes Service, Azure API Management, Azure Service Bus
  • Dapr for service invocation and pub/sub
  • Terraform, ArgoCD, GitHub Actions, Docker
  • Auth0, OAuth2, OpenID Connect, API key support for integrations
  • Nx monorepo, API contract-first development, automated testing

For this role, we especially value experience with:
  • Automated performance and load testing for APIs and distributed workflows
  • Synthetic monitoring and production-like traffic modeling
  • Observability-driven debugging and regression detection
  • AI-assisted test generation, failure analysis, and engineering workflow automation
  • CI/CD quality gates and release readiness automation
  • Database and message-queue performance analysis
  • Kubernetes workload tuning and capacity planning
  • End-to-end test automation for user-facing and service-level workflows

We value strong engineering judgment, a bias toward automation, and the ability to build systems that help product teams move faster with clear performance and reliability signals.

Hybrid

This role requires employees to be in-office based on our hybrid workplace model, balancing purposeful in-person collaboration with flexibility. For most teams, this means coming into the office two days each week.

Employees living more than 50 miles from an office location will work with their manager to determine in-office time based on business need.

Physical Requirements:

Office Environment - roles involving part to full time schedule in Office Environment. Based in our physical offices and work from home office/deskwork - Activity level: Sedentary, frequency most of work day.

Please click here for further physical requirement detail.

About Blue Shield Of California

Blue Shield of California is a not-for-profit health plan provider that has been providing Californians with access to high-quality healthcare for over 80 years. The company offers a range of health insurance products and services to individuals, families, and employers. Blue Shield of California is committed to improving the health and wellbeing of its members and the communities it serves. The company is also committed to sustainability and has implemented a number of initiatives to reduce its environmental impact.
Learn more about Blue Shield Of California
Size
7,000 employees
Industry
Founded
1981

Similar Jobs

More Jobs at Blue Shield Of California

More Enterprise Technology Jobs

Find similar Director, Performance Engineering and Test Automation jobs: