Perplexity: how language models are scored

Perplexity scores a language model by the per-word chance it gives held-out text, read as how many words it is choosing between at each step.

Part of Predicting the next word.

Read next