SLT proves that for a machine to generalize well, its capacity must be controlled relative to the amount of available training data. This led to the principle of , which balances the model's complexity against its success at fitting the training data. From Theory to Practice: Support Vector Machines
In classical statistics, the goal is often to find the parameters that best fit a known model. In SLT, the model itself is often unknown. The theory distinguishes between (the error on the training data) and Expected Risk (the error on future, unseen data). The Nature of Statistical Learning Theory
A measure of the discrepancy between the machine’s prediction and the actual output. The Problem of Generalization SLT proves that for a machine to generalize
A source of data that produces random vectors, usually assumed to be independent and identically distributed (i.i.d.). In SLT, the model itself is often unknown
A mechanism that provides the "target" or output value for each input vector.
At its heart, the nature of statistical learning is defined by four essential components: