Why squared error? | benkuhn.net
its computational convenience • connections to the Gaussian distribution • differentiability and basis independence • why not squared error • absolute-error methods
Someone recently asked on the statistics Stack Exchange why the squared error is used in statistics . This is something I'd been wondering about myself recently, so I decided to take a crack at answering it. The post below is adapted from that answer . Why squared error? It's true that one could choose to use, say, the absolute error instead of the squared error. In fact, the absolute error is often closer to what you "care about" when making predictions from your model. For instance, if you buy a stock expecting its future price to be $P_{predicted}$ and its future price is $P_{actual}$ inste
related reading
- Gregory Gundersengregorygundersen.com
- Kullback–Leibler divergence - Wikipediaen.wikipedia.org
- Proofs involving ordinary least squares - Wikipediaen.wikipedia.org
- What is the difference between a loss function and an error function? - Cross Validatedstats.stackexchange.com
- Not Quite the James-Stein Estimator – econometrics.blogeconometrics.blog
- Why Momentum Really Worksdistill.pub
- Exercises 2 -- Analytical Regression | 6.390 | IntroML | Fall24introml.mit.edu
- Stein's example - Wikipediaen.wikipedia.org
- Standard Error of the Regression vs. R-squared - Statistics By Jimstatisticsbyjim.com
- Loss function - Wikipediaen.wikipedia.org
- Linear Regressionmlu-explain.github.io
- generalized surearxiv.org