Contents
What happens if the regression model is overspecified?
If the regression model is overspecified (outcome 4), then the regression equation contains one or more redundant predictor variables. That is, part of the model is correct, but we have gone overboard by adding predictors that are redundant.
Is it bad to add too many variables to a model?
Perhaps the quote only concerns variables that are not correlated with other independent variables? Given this result, isn’t it just as bad to add variables that do not belong into the model, as it is leaving out variables that do (bias wise)? I don’t know where you’re pulling .5 from?
Can a regression model be used for prediction?
Such a regression model can be used, with caution, for prediction of the response, but should not be used to ascribe the effect of a predictor on the response. Also, as with including extraneous variables, we’ve also made our model more complicated and hard to understand than necessary.
Why are there so many predictor variables in factor analysis?
Powerful multi-variable techniques, such as multiple regression, make it easy to include a very large number of predictor variables in the hope of maximizing the explanatory power of the model. A similar problem occurs with factor analysis. There is nothing stopping us from factor-analyzing a random set of variables.
When is the bias not spread around the model?
This also hints at the very special circumstances under which the bias is not spread around. If, for example, the endogenous variable is uncorrelated with all the other X variables in the model, then the bias is not spread from the coefficient estimator for the endogenous variable to the coefficient estimators for the other variables.
Why do confounding variables bias the coefficient estimates?
This condition forces the model to attribute the effects of omitted variables to variables that are in the model, which biases the coefficient estimates. This problem occurs because your linear regression model is specified incorrectly—either because the confounding variables are unknown or because the data do not exist.
Which is true about the overspecification bias?
Suppose a true population model: Suppose that x 2 is in fact caused by x 1, or just by fluke they happen to have the following relationship: Where u_i is some centered random error. Say that the true beta is 1. The bias will be such that the beta will be on average 0.5 or even -0.5.