“If it happens that at the stage of designing the network one constructs a network too complex (for the given amount of training data), the confidence interval will be large. In this case, even if one could minimize the empirical risk down to zero, the amount of errors on the test set could be big. This case is called overfitting.” Vladimir N. Vapnik ( 1999 )