Full Job Description
Senior QA Engineer, Personalization
JOB SUMMARY:
The Sr QA Engineer, Personalization owns quality for personalization and decisioning capabilities within Marketing Technology (MarTech). This role is responsible for validating that model-driven experiences, real-time decisioning APIs, and personalized campaigns behave correctly, honor customer preferences and regulatory requirements, and reach customers as designed across app, web, in-store, pump, CRM, and paid channels. The Sr QA Engineer builds automated test frameworks for decisioning APIs and data validation, verifies experimentation integrity so A/B results can be trusted, and partners with engineering, data science, and platform owners on release readiness, model change validation, and production monitoring. As personalization consolidates under MarTech, this role establishes the quality gates, regression coverage, and validated production inventory that let the team ship personalization quickly and safely.
KEY RESPONSIBILITIES:
• Own end-to-end quality for personalization and decisioning capabilities across channels, including test planning, execution, and release sign-off for the personalization API, model-driven experiences, and campaign journeys.
• Build and maintain automated test frameworks for real-time decisioning APIs, covering functional, regression, contract, and performance testing.
• Validate model-driven experience quality: recommendation relevance, offer eligibility, suppression, ranking, and fallback behavior across app, web, in-store, pump, and CRM channels.
• Verify experimentation integrity, including A/B/C group assignment, holdouts, and measurement instrumentation, so test results are trustworthy.
• Validate the audience, segment, attribute, and offer data feeding personalization, catching upstream data issues before they reach customers.
• Test compliance behavior, including opt-in, CCPA and do-not-sell handling, quiet hours, and state-specific SMS rules.
• Partner with engineering, data science, and platform owners on model and attribute change validation, production monitoring, defect triage, and documentation of test coverage and the validated production inventory.
REQUIRED QUALIFICATIONS:
• Bachelors/4 Yr Degree
• 5+ years of relevant work experience
• Strong experience testing APIs and event-driven systems (REST clients, contract tests, performance tooling) and building automation frameworks (e.g., Playwright, Cypress, pytest, or similar).
• Solid SQL for data validation across large datasets.
• Experience testing marketing and CRM journeys (Salesforce Marketing Cloud or similar) across email, push, SMS, app, and web.
• Familiarity with CI/CD, observability, and testing-in-production practices (monitoring, alerting, canary validation).
• Strong documentation, defect triage, and cross-team communication skills, with compliant handling of customer data (opt-in, CCPA).
PREFERRED QUALIFICATIONS:
• Databricks or similar lakehouse experience a plus.
• Understanding of personalization and decisioning concepts: recommendations, next-best-offer, segmentation, experimentation, and holdouts.
CERTIFICATIONS:
• ISTQB or cloud (AWS/Azure) certifications a plus.