What are the advantages of different classification algorithms?
For instance, if we have large training data set with approx more than 10,000 instances and more than 100,000 features, then which classifier will be best to choose for classification?
Xavier Amatriain, PhD in CS, former Professor and coder has answered the question:
There are a number of dimensions you can look at to give you a sense of what will be a reasonable algorithm to start with, namely:
This list may seem a bit daunting because there are many issues that are not straightforward to answer. The good news though is, that as many problems in life, you can address this question by following the principle: use the least complicated algorithm that can address your needs and only go for something more complicated if strictly necessary.
- Logistic Regression
- Support Vector Machines
- Tree Ensembles
- Deep Learning