Contents
Overview
This page will cover in detail the plan to run the Loyalty script before the launch of Phase 1 in the loyalty migration for BK ES. The script will:
Delete all previous data from a specific date
Import all transaction data (for earn transactions) from BK ES for the last 7 months and user’s loyalty points balance
Create a remediation transaction to ensure the sum of transaction loyalty points matches the user’s balance loyalty points
Since launch was delayed from July to September, July change:
We are going to keep as valid all transactions migrated via script in the month of june that represented 6 months of data (Jan-Jun)
We are going to delete all Phase 0 earn transactions created since the beginning
We will import NEW data from Jun 24th until launch
1st Script Run (start Aug 1st)
RBIberia will drop file on before 12pm in OneDrive with data from until :
One file with users balance
One file with transactions data
This script is expected to take [] of days
2nd Script Run (start Aug 26th)
RBIberia will drop file on before 12pm in OneDrive with data from until :
One file with users balance
One file with transactions data
This script is expected to take [] of days
3rd Script Run (start Sep 1st)
RBIberia will drop file on before 12pm in OneDrive with data from until :
One file with users balance
One file with transactions data
This script is expected to take [] of days
4th Script Run & onwards to be daily
RBIberia drop file on | Data containing |
|---|---|
Sep 3rd | Sep 1st and Sep 2nd |
Sep 4th | Sep 3rd |
Sep 5th | Sep 4th |
Sep 6th | Sep 5th |
Sep 7th | Sep 6th |
Sep 8th | Sep 7th |
Sep 9th | Sep 8th |
Sep 10th | Sep 9th |
Inconsistent Users
While running initial script we spotted loyalty transactions for users that did not exist in RBI.
Users have now been created in RBI. We need to sync data for those guys from until
Next steps:
Fragalli, Andre prepare file of emails
Miguel-Romero, Almudena request RBIberia file with data (balance & transactions)
Scripts sequence and status
Status:
Completed:
In Progress:
Not started:
1st & 2nd Script Run
Updating data from 24-06-17 to 24-08-19.
PointBalance.csv → 10.746.533 usersTransactionHistory.csv → 4.970.645 transactions
Script | Input File | Status | Duration | Params | |
|---|---|---|---|---|---|
| 1 |
|
|
| 72h | CHUNK_SIZE=100 SLEEP=1000 |
| 2 |
|
|
| 42h | CHUNK_SIZE=100 SLEEP=1000 |
| 3 |
|
|
| 17.78h | CHUNK_SIZE=100 SLEEP=1000 |
| 4 |
|
|
| 43.80h | CHUNK_SIZE=100 SLEEP=1000 |
| 5 |
|
|
| 5.6h | CHUNK_SIZE=100 SLEEP=1000 |
3rd Script Run
Updating data from 24-08-20 to 24-09-02.
PointBalance.csv → 1.200.471 usersTransactionHistory.csv → 1.042.907 transactions
Script | Input File | Status | Duration | Params | |
|---|---|---|---|---|---|
| 1 |
|
|
| 5h | CHUNK_SIZE=100 SLEEP=1000 |
| 2 |
|
|
| 1h | CHUNK_SIZE=100 SLEEP=1000 |
| 3 |
|
|
| 3.7h | CHUNK_SIZE=100 SLEEP=1000 |
| 4 |
|
|
| 5h | CHUNK_SIZE=100 SLEEP=1000 |
| 5 |
|
|
| 2h | CHUNK_SIZE=100 SLEEP=1000 |
4th Script Run
Updating data from 24-09-03 to 24-09-04.
PointBalance.csv → 238.224 usersTransactionHistory.csv → 67.051 transactions
Script | Input File | Status | Duration | Params | |
|---|---|---|---|---|---|
| 1 |
|
|
| 1h21 | CHUNK_SIZE=100 SLEEP=1000 |
| 2 |
|
|
| 2.8min | CHUNK_SIZE=100 SLEEP=1000 |
| 3 |
|
|
| 14.37min | CHUNK_SIZE=100 SLEEP=1000 |
| 4 |
|
|
| 1h | CHUNK_SIZE=100 SLEEP=1000 |
| 5 |
|
|
| 44min | CHUNK_SIZE=100 SLEEP=1000 |
5th Script Run
Updating data from 24-09-04 to 24-09-05.
PointBalance.csv → 184.324 usersTransactionHistory.csv → 71.129 transactions
Script | Input File | Status | Duration | Params | |
|---|---|---|---|---|---|
| 1 |
|
|
| 47min | CHUNK_SIZE=100 SLEEP=1000 |
| 2 |
|
|
| 3.2min | CHUNK_SIZE=100 SLEEP=1000 |
| 3 |
|
|
| 1h8min | CHUNK_SIZE=100 SLEEP=1000 |
| 4 |
|
|
| 1h17min | CHUNK_SIZE=100 SLEEP=1000 |
| 5 |
|
|
| 3h41min | CHUNK_SIZE=100 SLEEP=1000 |
6th Script Run
Updating data from 24-09-05 to 24-09-09.
PointBalance.csv → 272.818 usersTransactionHistory.csv → 276.267 transactions
Script | Input File | Status | Duration | Params | |
|---|---|---|---|---|---|
| 1 |
|
|
| 1h13min | CHUNK_SIZE=100 SLEEP=1000 |
| 2 |
|
|
| 10min | CHUNK_SIZE=100 SLEEP=1000 |
| 3 |
|
|
| 4h38min | CHUNK_SIZE=100 SLEEP=1000 |
| 4 |
|
|
| 1h2min | CHUNK_SIZE=100 SLEEP=1000 |
| 5 |
|
|
| 52min | CHUNK_SIZE=100 SLEEP=1000 |
7th Script Run
Updating data from 24-09-10 to 24-09-10.
PointBalance.csv → 91.742 usersTransactionHistory.csv → 67.368 transactions
Script | Input File | Status | Duration | Params | |
|---|---|---|---|---|---|
| 1 |
|
|
| CHUNK_SIZE=100 SLEEP=1000 | |
| 2 |
|
|
| CHUNK_SIZE=100 SLEEP=1000 | |
| 3 |
|
|
| CHUNK_SIZE=100 SLEEP=1000 | |
| 4 |
|
|
| CHUNK_SIZE=100 SLEEP=1000 | |
| 5 |
|
|
| CHUNK_SIZE=100 SLEEP=1000 |
Add Comment