Contents
How to determine if a robust regression is appropriate?
To determine if a robust regression model would be appropriate, OLS regression is a good starting point. After running the regression, postestimation graphing techniques and an examination of the model residuals can be implemented to determine if there are any points in the data that might influence the regression results disproportionately.
What’s the relationship between OLS and robust regression?
In OLS regression, all cases have a weight of 1. Hence, the more cases in the robust regression that have a weight close to one, the closer the results of the OLS and robust regressions. We can also visualize this relationship by graphing the data points with the weight information as the size of circles.
How is a robust regression calculated in Stata?
Stata’s rreg command implements a version of robust regression. It first runs the OLS regression, gets the Cook’s D for each observation, and then drops any observation with Cook’s distance greater than 1. Then iteration process begins in which weights are calculated based on absolute residuals.
Why are unweighted regression models better than weighted models?
Hubbard at al [ 24 ]. note that when generalised estimating equations (GEE) are used, estimates can be inaccurate if the number of clusters is small, so treating initial seeds as clustering units can be problematic. Another study with mixed cluster sizes found that failure to adjust for clustering would have led to incorrect conclusions [ 25 ].
What is the kurtosis parameter in robust regression?
Bayesian robust regression, being fully parametric, relies heavily on such distributions. Under the assumption of t -distributed residuals, the distribution is a location-scale family. That is, . The degrees of freedom of the t -distribution is sometimes called the kurtosis parameter.
Is the robust regression method resistant to outliers?
The method is robust to outliers in the response variable, but turned out not to be resistant to outliers in the explanatory variables ( leverage points). In fact, when there are outliers in the explanatory variables, the method has no advantage over least squares.
Which is the Stata command for robust regression?
The Stata command for robust regression is rreg. The model portion of the command is identical to an OLS regression: outcome variable followed by predictors. We have added gen (weight) to the command so that we will be able to examine the final weights used in the model. rreg crime poverty single, gen (weight)