Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Panel
panelIconIdatlassian-note
panelIcon:note:
bgColor#DEEBFF

Documentation for CRM A/B Tests Catalog:

  • For each A/B test

    • Test category

    • Description of the test

    • Test performance per market (and month when test ended)

    • Visuals (if relevant)

  • This catalog is a non-exhaustive list of features/contents to A/B test and is recurrently being updated every time new relevant tests are done

  • The catalog only includes markets that have RBI recommended CRM Stack (Amplitude, Braze, mParticle) and focuses one the one serviced by RBI CRM services

...

  • Channel: push notifications

  • Description:

    • Version A: Special food is waiting for you! 😋 Beat the Monday blues with a hearty Burger King meal 🍔

    • Version B: Hey {{${first_name}}}, special food is waiting for you! 😋 Beat the Monday blues with a hearty Burger King meal 🍔

  • Test significance: 🟢

  • Test performance per market:

    • 🇨🇭 BK CH (Nov 2023): +28% CVR purchase no personalization (version A winning, available here)

...

  • Channel: push notifications

  • Description:

    • Version A: Explore Tuesday's BK Classics! 🍔🍟Order today and unlock new layers of deliciousness 👑

    • Version B: Explore Tuesday's BK Classics! 🍔🍟Order now and get crowns for every CHF you spend 👑

  • Test significance: 🟢

  • Test performance per market:

    • 🇨🇭 BK CH (Nov 2023): +12% CVR purchase with loyalty reference (version B winning), but both worse than control group

...

  • Channel: push notifications

  • Description:

    • Version A: Lazy Sunday Calls for BK Delights! 🍟 Lazy Sunday Sorted - BK Delivers Happiness! 🏠🍟 For T&C visit:

    • Version B: Lazy Sunday Calls for BK Delights! 🍟 Order now & enjoy BK's flavorful burgers! 🏠

  • Test significance: 🟢

  • Test performance per market:

    • 🇨🇭 BK CH (Nov 2023): +4.5% CVR purchase without direct CTA (version A winning)

...

  • Test significance: 🟢

  • Test performance per market:

    • 🇩🇪 BK DE (Nov 2023): +25% CVR purchase with personalization in the SL versus pre-header (version B winning)

...

  • Channel: push notifications

  • Description:

    • Version A: TGIF: Hochgenuss von Burger King®! 🎉

    • Version B: Freitag ist King 👑

  • Test significance: 🟢

  • Test performance per market:

    • 🇩🇪 BK DE (Nov 2023): +16% CVR purchase with young abbreviation (version A winning)

...

  • Channel: push notifications

  • Description: best send time for push notifications sends during the week (Wednesday). A/B testing 3pm vs 6pm

  • Test significance: 🟢

  • Test performance per market: 🇳🇱 BKNL (Q1 2024)

    • 6pm overperforms 3pm both in open rate and conversion rate

    • Next Steps:

      • Lunch vs Dinner

      • Winning option vs intelligent timing

...

1️⃣9️⃣ PMIX - Declared vs Actual

...