I am reading this new book "The hundred page machine learning book" and it answered one of questions regarding the use of squared loss in linear regression. Here it is.