Latent diffusion: how Stable Diffusion works
How latent diffusion (Stable Diffusion) runs denoising in an autoencoder's small latent: 48× fewer numbers per step, decoded to a full image once.
Part of Generating images.
Read first
- Variational autoencoders (VAE): latent space without holes
How a variational autoencoder (VAE) fills an autoencoder's latent holes: encode to a Gaussian, the reparameterization trick, and the KL penalty.