Batch normalization: why networks normalize each batch

How batch normalization (BatchNorm) evens out each channel over a mini-batch, what the learned γ and β do, and why it uses running averages at test time.

Part of Learning to see.

Read next

Related