Question

. A source transmits messages having probabilities {0.1, 0.4, 0.5} respectively. Calculate the entropy. ​

Answer 1

Answer:

1.5+0.4(2-0.5)+0.1+0.4

1.5+0.8-0.2+0.1+0.4

1.5+0.6+0.5

1.5+1.1

2.6

Explanation:

Entropy can be calculated for a random variable X with k in K discrete states as follows: H(X) = -sum(each k in K p(k)