Contents
Is robust regression always better?
If there are no outliers, then robust regression will give (although slightly less precise) results similar to those of ordinary linear regression. However, if there are outliers, then robust regression will give more reliable (i.e., less biased) results.
What does robust mean in regression?
In robust statistics, robust regression is a form of regression analysis designed to overcome some limitations of traditional parametric and non-parametric methods. In particular, least squares estimates for regression models are highly sensitive to outliers.
Why is robust regression used in data analysis?
Robust regression might be a good strategy since it is a compromise between excluding these points entirely from the analysis and including all the data points and treating all them equally in OLS regression. The idea of robust regression is to weigh the observations differently based on how well behaved these observations are.
Which is better robust regression or least squares regression?
Robust regression methods provide an alternative to least squares regression by requiring less restrictive assumptions. These methods attempt to dampen the influence of outlying cases in order to provide a better fit to the majority of the data.
Is the robust regression method resistant to outliers?
The method is robust to outliers in the response variable, but turned out not to be resistant to outliers in the explanatory variables ( leverage points). In fact, when there are outliers in the explanatory variables, the method has no advantage over least squares.
What’s the relationship between OLS and robust regression?
In OLS regression, all cases have a weight of 1. Hence, the more cases in the robust regression that have a weight close to one, the closer the results of the OLS and robust regressions. We can also visualize this relationship by graphing the data points with the weight information as the size of circles.