The benefit of the doubt

Pick by how good an option looks plus how unsure you still are about it.

Part of Bandits.

Read first

  • Explore or exploit

    Use what you know, or find out more: an agent that only does one does badly.

Read next

  • Counting what you missed

    Regret in multi-armed bandits: what not knowing the best arm costs, why a fixed share of exploring pays forever, and how to explore less as you learn.