entropy: Estimation of Entropy, Mutual Information and Related Quantities

Implements various estimators of entropy for discrete random variables, including the shrinkage estimator by Hausser and Strimmer (2009), the maximum likelihood and the Millow-Madow estimator, various Bayesian estimators, and the Chao-Shen estimator. It also offers an R interface to the NSB estimator. Furthermore, the package provides functions for estimating the Kullback-Leibler divergence, the chi-squared divergence, mutual information, and the chi-squared divergence of independence. It also computes the G statistic and the chi-squared statistic and corresponding p-values. Furthermore, there are functions for discretizing continuous random variables.

Version:	1.3.2
Depends:	R (≥ 3.4.0)
Published:	2025-04-07
DOI:	10.32614/CRAN.package.entropy
Author:	Jean Hausser [aut], Korbinian Strimmer [aut, cre]
Maintainer:	Korbinian Strimmer <strimmerlab at gmail.com>
License:	GPL (≥ 3)
URL:	https://strimmerlab.github.io/software/entropy/
NeedsCompilation:	no
Materials:	NEWS
CRAN checks:	entropy results

Documentation:

Reference manual:

entropy.html , entropy.pdf

Downloads:

Package source:	entropy_1.3.2.tar.gz
Windows binaries:	r-devel: entropy_1.3.2.zip, r-release: entropy_1.3.2.zip, r-oldrel: entropy_1.3.2.zip
macOS binaries:	r-release (arm64): entropy_1.3.2.tgz, r-oldrel (arm64): entropy_1.3.2.tgz, r-release (x86_64): entropy_1.3.2.tgz, r-oldrel (x86_64): entropy_1.3.2.tgz
Old sources:	entropy archive

Reverse dependencies:

Reverse depends:	binda, Cogito, sda
Reverse imports:	archetypal, autoBagging, biogram, bnclassify, CASMI, clustifyr, codez, deepMOU, DTWBI, DTWUMI, einet, epiregulon, EpiSemble, EvaluateCore, FSelector, funModeling, GB5mcPred, GenomicSig, ggsom, hilbertSimilarity, Informeasure, jenga, ldamatch, manydist, miRLAB, msu, naive, netSmooth, oclust, OpEnCAST, OpEnHiMR, PINSPlus, prefeR, randnet, rgnoisefilt, sabre, SCEnt, schex, scISR, segen, sincell, spinner, spooky, SuperCell, tetragon
Reverse suggests:	abn, embryogrowth, FSelectorRcpp, proxyC, quanteda.textstats, sgsR, WGCNA

Linking:

Please use the canonical form https://CRAN.R-project.org/package=entropy to link to this page.