Self-attention: queries, keys, values and masking

Self-attention lets every word attend to every word through queries, keys and values; why it needs position vectors, and how a decoder masks the future.

Part of Transformers.

Read first

Read next