...
$ value = (% incremental conversion)*($ average check test group - $ average check control group)*(average check)
This information is available here: add nena's dashboard once ready
...
It applies the same methodology listed above (so delta between test & control for both conversion rate and check) but instead of doing it on a campaign level, we will implement it on:
Weighted average for all ad hoc campaigns incrementality
Weighted average for all journeys incrementality
Example:
Journeys | Test Group | Control Group | Conversion Test | Conversion Control | Incremental Conversion |
|---|---|---|---|---|---|
Welcome Flow | 10,000 | 100 | 300 (30%) | 20 (20%) | +10% |
Activity Flow | 5,000 | 50 | 100 (20%) | 5 (10%) | +10% |
Journeys | Test Group | Control Group | Check Test | Check Control | Incremental Check |
|---|---|---|---|---|---|
Welcome Flow | 10,000 | 100 | 8 | 8.5 | +6.2% |
Activity Flow | 5,000 | 50 | 9 | 9 | +0% |
The impact is the weighted average (weighted for the people who received the campaign) of conversion, and check, for all the campaigns & journeys.