What is the difference between discriminant analysis and logistic regression?

What is the difference between discriminant analysis and logistic regression?

For categorized predictor variables, linear discriminant analysis remains preferable, and logistic regression overcomes discriminant analysis only when the number of categories is small (2 or 3).

Why do we use discriminant analysis?

Discriminant analysis is a versatile statistical method often used by market researchers to classify observations into two or more groups or categories. In other words, discriminant analysis is used to assign objects to one group among a number of known groups.

Which is better Gaussian discriminant analysis or logistic regression?

Therefore, Gaussian Discriminant Analysis works quite well for a small amount of data (say a few thousand examples) and can be more robust compared to Logistic Regression if our underlying assumptions about the distribution of the data are true Reference: http://cs229.stanford.edu/notes2020spring/cs229-notes2.pdf

What’s the difference between DFA and logistic regression?

LOGISTIC REGRESSION (LR): While logistic regression is very similar to discriminant function analysis, the primary question addressed by LR is “How likely is the case to belong to each group (DV)”. In contrast, the primary question addressed by DFA is “Which group (DV) is the case most likely to belong to”.

How are generative learning algorithms used in Gaussian discriminant analysis?

Such algorithms try to model P (y|X) i.e. given a feature set X for a data sample what is the probability it belongs to the class ‘y’. On the other hand, Generative Learning Algorithms follow a different approach, they try to capture the distribution of each class separately instead of finding a decision boundary among classes.

What’s the difference between discriminant analysis and regression?

Regression is done on data which has independent variables which are on ordinal scale. Whereas Discriminant analysis is done when the dependent variables have categorical data and independent variables are measured on a Likert scale.

Discriminant analysis creates discriminant function(s) in order to maximize the difference between the groups on the function. Logistic regression works like ordinary least squares regression but on the logit of the dependent variable. Discriminant analysis is really used only for categorization.

When do you use logistic regression in analytics?

Logistic regression is often used when we aren’t even interested in categorization but in getting the odds ratios for each variable. Unearth granular insights with advanced exploratory analytics.

Which is the best test for discriminant function analysis?

Furthermore, it indicates which of the predictors are the most differentiating (highest discriminant weights), in other words, which dimensions distinguish best among these consumer segments and why respondents fall into one group versus another group. In summary, it is a technique for classification, differentiation, and profiling.