// About this playbook

Metric Decision Tree

Navigate the landscape of evaluation metrics for classification, regression and ranking, including what to do when your classes are badly imbalanced.

It covers accuracy, precision, recall, F1, ROC-AUC, PR-AUC, MAE, RMSE, MAPE and the ranking metrics, with explicit handling of class imbalance. It is written for anyone about to report a number to a stakeholder who will act on it.

Every branch states the trade-off that decided it, so the recommendation you end on comes with the reasoning attached — something you can paste into a design note or defend in a review.

Decision tool Evaluation 20 min Intermediate Measure whether it works

Related playbooks

Who made this

Built by Tarek Atwan — twenty years in data and AI, four books, four-time Pluralsight Elite instructor, Fortune 500 engagements across eight countries. Consulting through Ensemble Methods. Source on GitHub.