Contents
What causes a wrong sign on a regression?
Multicollinearity is the usual suspect as JoFrhwld mentioned. Basically, if your variables are positively correlated, then the coefficients will be negatively correlated, which can lead to a wrong sign on one of the coefficients. One check would be to perform a principal components regression or ridge regression.
When does the sign of the regression coefficient flip?
When you also include IV2 to IV4 the sign of the standardised regression coefficient of IV1 flips to -.25 (i.e., it’s become negative). With regards to terminology, do you call this a “suppressor effect”?
Is there way to force a specific sign for each of the regression coefficients in SPSS?
The main problem that I am seeing is that an increase in one variable is causing an increase in the response when, in fact in reality, they must be negatively correlated. Is there a way to force a specific sign for each of the regression coefficients in SPSS?
What are the problems of redundant predictors in regression?
Redundant predictors lead to problems such as inflated standard errors for the regression coefficients. (Such problems are also associated with multicollinearity, which we’ll cover in Lesson 12).
When does the sign of a variable change in logistic regression?
In my logistic regression the sign of coefficients of a variable (location distance of an amenity) changes based on other variables (with time -ve, with travel distance +ve) in the model. When the location distance is the only variable in the model, it has +ve sign. This isn’t surprising.
What happens in regression when you change the inputs?
May or may not change B1. If B1was a comparison between nurses and lawyers, and the new added group are sociologists, B1won’t change, if there are no other predictor variables. If there are other predictor variables, all coefficients will be changed.
Why are regression coefficients that flip sign after including other predictors?
The differences essentially relate to the type of variable. It’s more useful to understand the underlying phenomenon rather than think in terms of a particular “paradox” or effect. For a causal perspective, the paper below does a good job of explaining why and I’ll quote at length their introduction and conclusion to whet your appetite.
What are the coefficients of a standardized regression?
Their interpretation is straightforward and intuitive: All other variables held constant, an increase of 1 unit in Xi is associated with an average change of βi units in Y. In the example above, if β 1 = 0.4 and β 2 = 0.2 (and both coefficients were statistically significant), then we can say that: