Versions Compared

Old Version 19

changes.mady.by.user Elleni, Anna

Saved on

compared with

New Version 20

changes.mady.by.user Elleni, Anna

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Panel
panelIconIdatlassian-note
panelIcon:note:
bgColor#DEEBFF

Documentation for CRM A/B Tests Catalog:

  • For each A/B test

    • Test category

    • Description of the test

    • Test performance per market (and month when test ended)

    • Visuals (if relevant)

  • This catalog is a non-exhaustive list of features/contents to A/B test and is recurrently being updated every time new relevant tests are done

  • The catalog only includes markets that have RBI recommended CRM Stack (Amplitude, Braze, mParticle) and focuses one the one serviced by RBI CRM services

...

  • Channel: push notifications

  • Description:

    • Version A: Special food is waiting for you! 😋 Beat the Monday blues with a hearty Burger King meal 🍔

    • Version B: Hey {{${first_name}}}, special food is waiting for you! 😋 Beat the Monday blues with a hearty Burger King meal 🍔

  • Test significance: 🟢

  • Test performance per market:

    • 🇨🇭 BK CH (Nov 2023): +28% CVR purchase no personalization (version A winning, available here)

...

  • Channel: push notifications

  • Description:

    • Version A: Explore Tuesday's BK Classics! 🍔🍟Order today and unlock new layers of deliciousness 👑

    • Version B: Explore Tuesday's BK Classics! 🍔🍟Order now and get crowns for every CHF you spend 👑

  • Test significance: 🟢

  • Test performance per market:

    • 🇨🇭 BK CH (Nov 2023): +12% CVR purchase with loyalty reference (version B winning), but both worse than control group

...

  • Channel: push notifications

  • Description:

    • Version A: Lazy Sunday Calls for BK Delights! 🍟 Lazy Sunday Sorted - BK Delivers Happiness! 🏠🍟 For T&C visit:

    • Version B: Lazy Sunday Calls for BK Delights! 🍟 Order now & enjoy BK's flavorful burgers! 🏠

  • Test significance: 🟢

  • Test performance per market:

    • 🇨🇭 BK CH (Nov 2023): +4.5% CVR purchase without direct CTA (version A winning)

...

  • Test significance: 🟢

  • Test performance per market:

    • 🇩🇪 BK DE (Nov 2023): +25% CVR purchase with personalization in the SL versus pre-header (version B winning)

...

  • Channel: push notifications

  • Description:

    • Version A: TGIF: Hochgenuss von Burger King®! 🎉

    • Version B: Freitag ist King 👑

  • Test significance: 🟢

  • Test performance per market:

    • 🇩🇪 BK DE (Nov 2023): +16% CVR purchase with young abbreviation (version A winning)

...

  • Channel: email

  • Description: different email content based on PMIX preference. Specifically, split between vegetarian & others.

  • Test significance: 🔴 the test set up was incorrect, as we didn’t have a control group specifically among the vegetarian that received the “all” variants.

  • Test performance per market:

1️⃣ 1️⃣ IAM

  • Channel: in app messages

  • Description:

  • Test significance: 🔴 the test set up was incorrect, as we didn’t have a control group specifically among the vegetarian that received the “all” variants.

  • Test performance per market:

...