Estimating Differential Entropy using Recursive Copula Splitting
Estimating Differential Entropy using Recursive Copula Splitting
A method for estimating the Shannon differential entropy of multidimensional random variables using independent samples is described. The method is based on decomposing the distribution into a product of the marginal distributions and the joint dependency, also known as the copula. The entropy of marginals is estimated using one-dimensional methods. …