When the world changes

A plain average never forgets; a fixed step trusts recent rewards more, and keeps up when things change.

Part of Bandits.

Read first

  • Explore or exploit

    Use what you know, or find out more: an agent that only does one does badly.

Read next

  • Optimism explores

    Expect the best of everything untried, and even a learner that never gambles tries it all.