Latent semantic analysis (LSA): word vectors from counts
How latent semantic analysis (LSA) turns word–document counts into dense word vectors with a truncated SVD, compared by cosine and weighted by TF-IDF.
Part of Words as numbers.
Read next
- Skip-gram and negative sampling (word2vec)
How word2vec's skip-gram learns word vectors by guessing each word's neighbours, and why negative sampling makes it fast. Toy corpus, live training.
Related
- Principal component analysis (PCA): the longest shadow
Principal component analysis (PCA) finds the directions of most variance, the covariance's top eigenvectors, and how many to keep for the least loss.