How to get probabilities from XGBoost? - Data Science Central2020-09-19T16:44:12Zhttps://www.datasciencecentral.com/forum/topics/how-to-get-probabilities-from-xgboost?feed=yes&xn_auth=noWhy are you saying it doesn't…tag:www.datasciencecentral.com,2018-07-26:6448529:Comment:7471662018-07-26T20:17:35.504ZDaniel Mastropietrohttps://www.datasciencecentral.com/profile/DanielMastropietro
<p>Why are you saying it doesn't provide predicted probabilities?</p>
<p>Like any other predictive model it gives the predictions.</p>
<p>Recall that a XGBoost model is a set of iterative Decision Trees (one Decision Tree built on the residual of the "previous" Decision Tree). In a single decision tree model, the predicted probabilities (assuming your target is binary) is the proportion of the event in the leaf where the analyzed case falls based on the tree path defined by its characteristics.…</p>
<p>Why are you saying it doesn't provide predicted probabilities?</p>
<p>Like any other predictive model it gives the predictions.</p>
<p>Recall that a XGBoost model is a set of iterative Decision Trees (one Decision Tree built on the residual of the "previous" Decision Tree). In a single decision tree model, the predicted probabilities (assuming your target is binary) is the proportion of the event in the leaf where the analyzed case falls based on the tree path defined by its characteristics. It might be more elaborate, but conceptually XGBoost will give the prediction probability by following the paths of the different fitted Decision Trees and looking at the proportion of events in the final leaf reached.</p>
<p>What software are you using and what outcome are you obtaining with your XGBoost model?</p>