Algorithms | Training complexity | Prediction complexity |
---|---|---|
Random Forest | O(n2pntrees) | O(pntrees) |
Support Vector Machine | O(n2p + n3) | O(pnsv) |
AdaBoost | O(npntrees) | O(pntrees) |
Decision Tree | O(n2p) | O(p) |
Gradient Boosting | O(npntrees) | O(pntrees) |
K-Nearest Neighbors | N/A | O(np) |