Kernel trick: curved boundaries from inner products
How the kernel trick lets SVMs and other linear methods learn curved boundaries: feature maps, the representer theorem and the Gaussian (RBF) kernel.
Part of Linear classifiers.
Read first
- Soft-margin SVM: slack, hinge loss and C
How a soft-margin support vector machine (SVM) lets points sit inside or across the street for a price: slack, the hinge loss, and the C trade-off.
Read next
- Decision trees: Gini, entropy and greedy splits
How a decision tree picks each split greedily by Gini impurity or entropy, and why a tree grown until every leaf is pure overfits.