How is the PCA used in a regression?
The PCA was performed using the correlation matrix option, using the software PC-ORD, v. 4.21 (McCune & Mefford 1999). For each set of variables, only the variables with coordinates higher than 0.20, for the two first axes, of the PCA, were selected to be used in multiple regression analysis.
Can a PCA be used to select variables?
For each set of variables, only the variables with coordinates higher than 0.20, for the two first axes, of the PCA, were selected to be used in multiple regression analysis. I could not find literature that confirms that it’s OK to do this, but I think it is not wrong.
How is principal component analysis different from linear regression?
Principal component analysis (PCA) is a statistical procedure that uses an orthogonal transformation to convert a set of observations of possibly correlated variables into a set of values of linearly uncorrelated variables called principal components The concept that I would like to explore is how different this is from Linear Regression.
What’s the difference between PCA and principal component analysis?
To quote wiki for a more detail definition of PCA: Principal component analysis (PCA) is a statistical procedure that uses an orthogonal transformation to convert a set of observations of possibly correlated variables into a set of values of linearly uncorrelated variables called principal components
When to disregard PCa results when selecting predictors?
If you want to use individual variables as predictors rather than the poorly-performing components that summarize dimensions in the data, the most consistent thing to do is to disregard the PCA results when selecting predictors.
Can you combine two correlated outcomes with PCA?
Combine the correlated outcomes using PCA, then use that as the single outcome variable. (This is, incidentally, what MANOVA does). In both cases, you can no longer interpret the individual variables.