Counting what you missed
Regret in multi-armed bandits: what not knowing the best arm costs, why a fixed share of exploring pays forever, and how to explore less as you learn.
Part of Bandits.
Read first
- The benefit of the doubt
Pick by how good an option looks plus how unsure you still are about it.
Read next
- Preferences, not values
Learn how much to favour each option, and compare every reward with what you usually get.