LSTM: long short-term memory and its gates
How long short-term memory (LSTM) networks use a cell state and forget, input and output gates to carry words, and gradients, across long sentences.
Part of Predicting the next word.
Read next
- IBM Model 1: learning word alignments for translation
How IBM Model 1 learns word translations from sentence pairs alone: hidden alignments summed out, EM, and the noisy channel model for translation.