Sequential Bayesian decision tool
This tool is designed to help with Sequential Bayesian decision making.
You may enter the number of trials for 5 or less
variants and number of successes after a test. The tool will calculate
the probabilities that each of the variants is the most successful.
After each calculation the tool will suggest the split for the next
iteration. It can be used as a simulator where
the tool will 'home in' on a set of 'hidden probabilities' to find the
best.
Example of usage:
- Click 'calculate' - (it takes about 5 seconds) - observe graph which appears at base of page.
Example of usage as a simulation:
- Click 'simulate' - which fills the successes row with simulated
successes using the "hidden" probabilities of success in blue row
- Click 'calculate' - observe graph which appears at base of page. Observe probabilities of which is best.
- Click 'suggest split' which suggests the numbers to send to the variants in next iteration.
- Click 'use suggestion' which fills the numbers for the next iteration at top of tool.
- Go to step 1 of this list - continue until exhausted.
Extended example of use for a real set of tests:
- Edit names of "variant 1", "variant 2" etc..
- Overwrite/edit numbers of trials for each variant.
- Overwrite/edit numbers of successes after the trial.
- Click 'calculate' - observe graph which appears at base of page.
- Observe the probabilities.
- Decide how many trials in next iteration, overwrite/edit/leave number in appropriate box.
- Click 'suggest split' which suggests the numbers to send to the variants in next iteration.
- Click 'use suggestion' which fills the numbers for the next iteration at top of tool.
- Go to step 3 of this list
Notes: It can take a long time (10's secs - minutes) with larger
numbers. You can zoom (double click, roller wheel) and pan (grab) the
graph.
Link to explanatory simulation: here
|