Variational autoencoders (VAE): latent space without holes
How a variational autoencoder (VAE) fills an autoencoder's latent holes: encode to a Gaussian, the reparameterization trick, and the KL penalty.
Part of Generating images.
Read next
- Diffusion models (DDPM): from noise to images
How denoising diffusion probabilistic models (DDPM) add noise step by step, learn to predict it with a simple MSE loss, and generate by denoising.
- Latent diffusion: how Stable Diffusion works
How latent diffusion (Stable Diffusion) runs denoising in an autoencoder's small latent: 48× fewer numbers per step, decoded to a full image once.
Related
- Principal component analysis (PCA): the longest shadow
Principal component analysis (PCA) finds the directions of most variance, the covariance's top eigenvectors, and how many to keep for the least loss.