Question

Find the entropy of a soyrce generating n no of msgs having diff probabilities of occurance

Answer 1

Answer:

Let the probability of having a 0 be q, thus the probability of having ... Let N be the number of symbols the source can emit, i.e. N = 2, m be the order .... Let us consider the messages containing one (n = 1) symbol.