- Discriminative and generative models have distinct differences,
- Discriminative methods are simpler but not necessarily better,
- This One Picture outlines a few major differences between the methods, along with a few examples and use cases.

Read any textbook on the difference between generative and discriminative models and you'll usually find the explanation is usually less than intuitive. One of the better explanations I've read [1] is the following analogy: you are talking to someone who is speaking a language you don't understand. Your task is to figure out what language they are speaking (without the use of Google Translate!). You have two options:

**Generative method:**Learn each language and then use that knowledge to determine which language is being spoken.**Discriminative method**: Determine the linguistic differences without actually learning the language.

As you may be able to tell from this simple analogy. *discriminative methods are much simpler.* But there are situations when you might want to use generative methods instead. For example, generative models are much better for finding missing values (i.e. they can generate data). However, if classification accuracy is your goal, a discriminative method, which "discriminates" (classifies) is likely the better choice. In sum:

References

[1] Machine Learning: Generative and Discriminative Models

[2] Reasoning about Missing Data in Machine Learning

[3] Jebara, T. (2019). Machine Learning Discriminative and Generative. Springer.

© 2021 TechTarget, Inc. Powered by

Badges | Report an Issue | Privacy Policy | Terms of Service

**Most Popular Content on DSC**

To not miss this type of content in the future, subscribe to our newsletter.

- Book: Applied Stochastic Processes
- Long-range Correlations in Time Series: Modeling, Testing, Case Study
- How to Automatically Determine the Number of Clusters in your Data
- New Machine Learning Cheat Sheet | Old one
- Confidence Intervals Without Pain - With Resampling
- Advanced Machine Learning with Basic Excel
- New Perspectives on Statistical Distributions and Deep Learning
- Fascinating New Results in the Theory of Randomness
- Fast Combinatorial Feature Selection

**Other popular resources**

- Comprehensive Repository of Data Science and ML Resources
- Statistical Concepts Explained in Simple English
- Machine Learning Concepts Explained in One Picture
- 100 Data Science Interview Questions and Answers
- Cheat Sheets | Curated Articles | Search | Jobs | Courses
- Post a Blog | Forum Questions | Books | Salaries | News

**Archives:** 2008-2014 |
2015-2016 |
2017-2019 |
Book 1 |
Book 2 |
More

**Most popular articles**

- Free Book and Resources for DSC Members
- New Perspectives on Statistical Distributions and Deep Learning
- Time series, Growth Modeling and Data Science Wizardy
- Statistical Concepts Explained in Simple English
- Machine Learning Concepts Explained in One Picture
- Comprehensive Repository of Data Science and ML Resources
- Advanced Machine Learning with Basic Excel
- Difference between ML, Data Science, AI, Deep Learning, and Statistics
- Selected Business Analytics, Data Science and ML articles
- How to Automatically Determine the Number of Clusters in your Data
- Fascinating New Results in the Theory of Randomness
- Hire a Data Scientist | Search DSC | Find a Job
- Post a Blog | Forum Questions

## You need to be a member of Data Science Central to add comments!

Join Data Science Central