Entropy Region and Convolution

Abstract

The entropy region is constructed from vectors of random variables by collecting Shannon entropies of all subvectors. Its shape is studied here by means of polymatroidal constructions, notably by convolution. The closure of the region is decomposed into the direct sum of tight and modular parts, reducing the study to the tight part. The relative interior of the reduction belongs to the entropy region. Behavior of the decomposition under self-adhesivity is clarified. Results are specialized and extended to the region constructed from four tuples of random variables. This and computer experiments help to visualize approximations of a symmetrized part of the entropy region. The four-atom conjecture on the minimal Ingleton score is refuted.

Locations

• Repository of the Academy's Library (Library of the Hungarian Academy of Sciences) - View - PDF
• arXiv (Cornell University) - View - PDF
• IEEE Transactions on Information Theory - View