Reward versus value
Reward is what’s good now; value is all the reward still to come. Choose by value.
Part of Values.
Read first
- Learning from reward
Learning from a score, not from answers: try, see how it went, do more of what worked.
Read next
- Temporal-difference learning
Nudge each guess toward the next one, and learn during the game, not after it.
- A square is worth its neighbours
A state is worth the average of reward plus the discounted worth of where you land: the Bellman equation.
- Reward what you want
An agent chases exactly the reward it is given: reward the outcome, never the steps you expect.
- Sooner is worth more
Count each reward further off for less, and even a task that never ends has a finite return.