Additive versus non-additive property of entropy Frank March 17, 2010 News Comments are off Shannon entropy is said additive in the sense that the entropy of the joint distribution H(X*Y) is the sum of the entropies: H(X*Y) = H(X)+H(Y). This property is not true for the quadratic entropy (sum of squares). The Java program Continue Reading Additive versus non-additive property of entropy