Soft-margin SVM: slack, hinge loss and C
How a soft-margin support vector machine (SVM) lets points sit inside or across the street for a price: slack, the hinge loss, and the C trade-off.
Part of Linear classifiers.
Read first
- Maximum margin: the hard-margin SVM's widest street
How a hard-margin support vector machine (SVM) picks the separating line with the widest margin, 2/‖w‖, and why only its support vectors decide it.
Read next
- Kernel trick: curved boundaries from inner products
How the kernel trick lets SVMs and other linear methods learn curved boundaries: feature maps, the representer theorem and the Gaussian (RBF) kernel.