Previous |  Up |  Next


The paper is oriented to physical, statistical and information meaning of the term entropy. Various entropy definitions are used for the calculations and estimations on small examples. The concept of Alfred Renyi is demonstrated here as a generalization of Shannon entropy. The entropy estimates, which are useful in many areas of data processing, are biased in general and this effect is also demonstrated.
Partner of
EuDML logo