Many articles have been written about the top machine learning algorithms: click here and here for instance. Most of them seem to define top as oldest, and thus most used, ignoring modern, efficient algorithms fit for big data, such as indexation, attribution modeling, collaborative filtering, or recommendation engines used by companies such as Amazon, Google, or Facebook. 

I received this morning and advertisement for a (self-published) book called Master Machine Learning Algorithms, and I could not resist to post the author's list of top 10 machine learning algorithms:: 

Linear Algorithms:

• Algorithm 1: Linear Regression
• Algorithm 2: Logistic Regression
• Algorithm 3: Linear Discriminant Analysis

Nonlinear Algorithms:

• Algorithm 4: Classification and Regression Trees
• Algorithm 5: Naive Bayes
• Algorithm 6: K-Nearest Neighbors
• Algorithm 7: Learning Vector Quantization
• Algorithm 8: Support Vector Machines

Ensemble Algorithms:

• Algorithm 9: Bagged Decision Trees and Random Forest
• Algorithm 10: Boosting and AdaBoost

Bonus #1: Gradient Descent

• The Gradient Descent algorithm is also covered as it us used as the optimization algorithm at the core of so many machine learning algorithms

You can check the book here.

Some of these techniques such as Naive Bayes (variables are almost never uncorrelated), Linear Discriminant Analysis (clusters are almost never separated by hyperplanes), or Linear Regression (numerous model assumptions - including linearity - are almost always violated in real data)  have been so abused that I would hesitate teaching them. This is not a criticism of the book; most textbooks mention pretty much the same algorithms, and in this case, even skipping all graph-related algorithms. Even k Nearest Neighbors have modern, fast implementations not covered in traditional books - we are indeed working on this topic and expect to have an article published shortly about it.

If anything, it proves that modern techniques take a lot of time to hit the classroom and the textbooks. You might have to attend classes taught by real practitioners (people who worked for big data solutions vendors) to learn modern tools that will give you a competitive edge on the job market. Though you can discover a lot of this free "hidden knowledge" on our website, using our data science search engine.  An publisher such as O'Reilly, as well as some universities with an applied data science department, provide good education about these state-of-the-art techniques, with case studies. My upcoming book Data Science 2.0 will cover much of the topic, and my previous Wiley book is a good starting point. And you can learn quite a bit from our apprenticeship (for self-learners only at this time).

DSC Resources

• Career: Training | Books | Cheat Sheet | Apprenticeship | Certification | Salary Surveys | Jobs
• Knowledge: Research | Competitions | Webinars | Our Book | Members Only | Search DSC
• Buzz: Business News | Announcements | Events | RSS Feeds
• Misc: Top Links | Code Snippets | External Resources | Best Blogs | Subscribe | For Bloggers

Additional Reading

• What statisticians think about data scientists
• Data Science Compared to 16 Analytic Disciplines
• 10 types of data scientists
• 91 job interview questions for data scientists
• 50 Questions to Test True Data Science Knowledge
• 24 Uses of Statistical Modeling
• 21 data science systems used by Amazon to operate its business
• Top 20 Big Data Experts to Follow (Includes Scoring Algorithm)
• 5 Data Science Leaders Share their Predictions for 2016 and Beyond
• 50 Articles about Hadoop and Related Topics
• 10 Modern Statistical Concepts Discovered by Data Scientists
• Top data science keywords on DSC
• 4 easy steps to becoming a data scientist
• 22 tips for better data science
• How to detect spurious correlations, and how to find the real ones
• 17 short tutorials all data scientists should read (and practice)
• High versus low-level data science

Follow us on Twitter: @DataScienceCtrl | @AnalyticBridge