A dataset has a 50-50 split on a given feature having two classes. What is the entropy of the full dataset for that feature?
Answers
Answered by
0
Answer:
⏩Sorry mate...i dnt know⏪
Answered by
0
Answer:
1
Explanation:
A dataset with a 50/50 split of samples for the two classes would have a maximum entropy (maximum surprise) of 1 bit, whereas an imbalanced dataset with a split of 10/90 would have a smaller entropy as there would be less surprise for a randomly drawn example from the dataset.
For example, in a binary classification problem (two classes), we can calculate the entropy of the data sample as follows:
Entropy = -(p(0) * log(P(0)) + p(1) * log(P(1)))
Similar questions