Preferences, not values
Learn how much to favour each option, and compare every reward with what you usually get.
Part of Bandits.
Read first
- Explore or exploit
Use what you know, or find out more: an agent that only does one does badly.
Read next
- Reading the situation
When a clue tells you which situation you are in, learn a rule from situation to choice.
- Learning the policy itself
REINFORCE, the Monte Carlo policy gradient: make each move more likely in proportion to how much better than usual its return was, with a baseline to cut noise.
Related
- A centre and a spread
Gaussian policies for continuous actions: draw each action from a bell curve and let the policy gradient move its centre and learn how widely to explore.