Question

What will be the effect on the depth of the tree of min_samples_leaf is set to 1

Answer 1

In this post we will explore the most important parameters of Decision tree model and how they impact our model in term of over-fitting and under-fitting.

We will use the Titanic Data from kaggle. For the sake of this post, we will perform as little feature engineering as possible as it is not the purpose of this post.

Answer 2

Answer:

depth of tree will increase

Explanation:

if min_sample_leaf is set to 1 , the depth of the tree will increase many fold , and the tree will become very complex , since it tries to make as many branches as it can , even if a leaf has one sample .

this is the classic case of overfitting , whereby the decision tree learns the training data set and will perform poorly on test data set , generally for such Tree , the accuracy of training data set will be close to 100% while it can reduce a lot when the model is applied on test data set.