Tag: xgboost

Tuning the hyperparameter with gridsearch results in overfitting

grid-search hyperparameters python xgboost

Tuning the hyperparameter with gridsearch results in overfitting. The train error is definitely low, but the test error is high. Can’t you adjust the hyperparameter to lower the test error? before tuning train_error: 0.386055, test_error: 0.674069 -after tuning train_error: 0.070645, test_error: 0.70825…

GridSearchCV progress in Jupiter Notebook

gridsearchcv jupyter-notebook machine-learning python xgboost

Is it possible to see the progress of GridSearchCV in a Jupyter Notebook? I’m running this script in python: I can see only some warnings in the output of the cell. Answer You want the verbose parameter: An example of what I got on toy data:

What does the value of ‘leaf’ in the following xgboost model tree diagram means?

decision-tree machine-learning python random-forest xgboost

I am guessing that it is conditional probability given that the above (tree branch) condition exists. However, I am not clear on it. If you want to read more about the data used or how do we get this diagram then go to : http://machinelearningmastery.com/visualize-gradient-boosting-decision-trees-xgboost-pyth…