What's the overall point of training error in the goal of regression (i.e, making predictions)?
You might say something like, "well, you see, training error can help you determine which model of complexity is the best to use. "
And to that, some would say, "No you can't. Low training error could just mean that your model is conforming to whatever data you're training the model with, A.K.A overfitting"
What's the point of calculating training error if it's not a good predictive measure of performance?
Especially when we go through and say, to hell with training error, just use validation error..
When will we ever use training error?
Low training error can be indicative of overfitting.. is that the only use of it?