Data Mining - (Test|Expected|Generalization) Error

Thomas Bayes


Test error is the prediction error that we incur on new data. The test error is actually how well we'll do on future data the model hasn't seen.

The test error is the average error that results from using a statistical learning method to predict the response on a new observation, one that was not used in training the method.


Test error can be estimated :

Discover More
Thomas Bayes
Data Mining - Training Error

Training error is the prediction error we get applying the model to the same data from which we trained. Training error is much easier to compute than test error. Train error is often lower than test...
Lasso Vs Ridge Regression211
Statistics - (Shrinkage|Regularization) of Regression Coefficients

Shrinkage methods are more modern techniques in which we don't actually select variables explicitly but rather we fit a model containingall p predictors using a technique that constrains or regularizes...
Model Complexity Error Training Test
Statistics - Bias-variance trade-off (between overfitting and underfitting)

The bias-variance trade-off is the point where we are adding just noise by adding model complexity (flexibility). The training error goes down as it has to, but the test error is starting to go up. The...
Subset Selection Model Path
Statistics - Model Selection

Model selection is the task of selecting a statistical model from a set of candidate models through the use of criteria's Dimension reduction procedures generates and returns a sequence of possible...
Thomas Bayes
Statistics Learning - Prediction Error (Training versus Test)

The Prediction Error tries to represent the noise through the concept of training error versus test error. We fit our model to the training set. We take our model, and then we apply it to new data that...

Share this page:
Follow us:
Task Runner