When should I use accuracy?

When should I use accuracy?

Accuracy is used when the True Positives and True negatives are more important while F1-score is used when the False Negatives and False Positives are crucial. Accuracy can be used when the class distribution is similar while F1-score is a better metric when there are imbalanced classes as in the above case.

How do you evaluate binary classifiers?

Must-Know: How to evaluate a binary classifier

1. True Positive Rate (TPR) or Hit Rate or Recall or Sensitivity = TP / (TP + FN)
2. False Positive Rate(FPR) or False Alarm Rate = 1 – Specificity = 1 – (TN / (TN + FP))
3. Accuracy = (TP + TN) / (TP + TN + FP + FN)
4. Error Rate = 1 – accuracy or (FP + FN) / (TP + TN + FP + FN)

How is the performance of a binary classifier measured?

(July 2014) In addition to sensitivity and specificity, the performance of a binary classification test can be measured with positive predictive value (PPV), also known as precision, and negative predictive value (NPV).

When is classification accuracy is not enough information?

Classification accuracy alone is typically not enough information to make this decision. In this post, we will look at Precision and Recall performance measures you can use to evaluate your model for a binary classification problem. The breast cancer dataset is a standard machine learning dataset.

What does precision and recall represent in binary classifier?

In the context of a binary classifier, precision and recall represent the following: P recision = T P T P +F P P r e c i s i o n = T P T P + F P Recall = T P T P +F N R e c a l l = T P T P + F N Taking either of precision and recall on their own is not useful. For example, suppose a SPAM detection model is tuned to detect all SPAM emails.

What does MCC tell you about binary classification metrics?

First, because MCC is a metric that considers all possibilities of binary classification (TP, TN, FP, and FN). Secondly, MCC is robust to unbalanced datasets. Finally, the result of MCC is a normalized coefficient between -1 and 1 that is straightforward to interpret.