Question

Example to calculate information gain in machine learning decision tree

Answer 1

Answer:

Example: Construct a Decision Tree by using “information gain” as a criterion

Calculate entropy of Target.

Entropy for every attribute A, B, C, D needs to be calculated. Using information gain formula we will subtract this entropy from the entropy of target. The result is Information Gain.