Phrase guide

joint entropy

noun · 1 senses · updated from the 2026-07-25 local source snapshot

Definitions and examples are grouped by meaning. Pronunciation, history, word forms, translations, descendants, synonyms, antonyms, derived terms, and related words appear whenever the source provides them.

Sound

Pronunciation

Each Play button uses your device's default local English voice, or a natural local fallback. The selected voice name appears after playback. This is synthesized speech, not a source recording.

No pronunciation record was provided for this word.

1

noun

Meaning 1

The Shannon entropy of a "script" whose "characters" are elements of the Cartesian product of the sets of characters of the component scripts.

Definition source: English Wiktionary via Wiktextract

Usage: countable, uncountable

Topics: computing, engineering, information-theory, mathematics, natural-sciences, physical-sciences, sciences

Examples

  • If random variables X and Y are mutually independent, then their joint entropy H(X,Y) is just the sum H(X)#43;H(Y) of its component entropies. If they are not mutually independent, then their joint entropy will be H(X)#43;H(Y)-I(X#59;Y) where I(X#59;Y) is the mutual information of X and Y.

Meaning relationships

Synonyms: none provided

Antonyms: none provided

History

Etymology

No etymology was provided for this word.