evaluation (2) 썸네일형 리스트형 [Theorem] Bias vs Variance 1. Intersection between Bias and Variance Let's review about overfitting problem and underfitting problem. Underfitting problem is the problem when we use too much low degree polynomial term. Overfitting problem is the problem when we use too much high degree polynomial term. So, when we plot training error of \(J(\Theta)\) by degree of polynomial, we can see that in lower degree, error is high,.. [Theorem] Overfitting 1. Overfitting in Linear Regression When degree of freedom is low, \(H(x)\) can only predict output in simple way and can't predict every case of x. This called 'underfitting' or 'high bias'. When degree of freedom is proper(not too low and not too high), predicting output is pretty well. When degree of freedom is high, model can predict output well, but can't generalize well to predict new data.. 이전 1 다음
