Preferences, not values

Learn how much to favour each option, and compare every reward with what you usually get.

Part of Bandits.

Read first

  • Explore or exploit

    Use what you know, or find out more: an agent that only does one does badly.

Read next

  • Reading the situation

    When a clue tells you which situation you are in, learn a rule from situation to choice.

  • Learning the policy itself

    REINFORCE, the Monte Carlo policy gradient: make each move more likely in proportion to how much better than usual its return was, with a baseline to cut noise.

Related

  • A centre and a spread

    Gaussian policies for continuous actions: draw each action from a bell curve and let the policy gradient move its centre and learn how widely to explore.