Kullback–Leibler divergence
measurement of how one probability distribution is different from a second, reference probability distribution
Press Enter · cited answer in seconds
0 sources
Kullback–Leibler divergence
Summary
Kullback–Leibler divergence is a f-divergence[1]. It draws 1,659 Wikipedia views per month (f_divergence category, ranking #1 of 1).[2]
Key Facts
- Kullback–Leibler divergence's instance of is recorded as f-divergence[3].
- Solomon Kullback is named after Kullback–Leibler divergence[4].
- Richard Leibler is named after Kullback–Leibler divergence[5].
- Kullback–Leibler divergence's Bibliothèque nationale de France ID is recorded as 180900511[6].
- Kullback–Leibler divergence's Freebase ID is recorded as /m/02d0qq[7].
- Kullback–Leibler divergence's defining formula is recorded as D_\text{KL}(P \parallel Q) = \sum_{x\in\mathcal{X}} P(x) \log\left(\frac{P(x)}{Q(x)}\right)[8].
- Kullback–Leibler divergence's studied by is recorded as category theory[9].
- Kullback–Leibler divergence's studied by is recorded as thermodynamics[10].
- Kullback–Leibler divergence's studied by is recorded as information theory[11].
- Kullback–Leibler divergence's MathWorld ID is recorded as RelativeEntropy[12].
- Kullback–Leibler divergence's maintained by WikiProject is recorded as WikiProject Mathematics[13].
- Kullback–Leibler divergence's Microsoft Academic ID is recorded as 171752962[14].
- Kullback–Leibler divergence's in defining formula is recorded as P[15].
- Kullback–Leibler divergence's in defining formula is recorded as Q[16].
- Kullback–Leibler divergence's in defining formula is recorded as \mathcal{X}[17].
- Kullback–Leibler divergence's OpenAlex ID is recorded as C171752962[18].
- Kullback–Leibler divergence's OpenAlex ID is recorded as C2983203078[19].
- Kullback–Leibler divergence's ScienceDirect topic ID is recorded as engineering/kullback-leibler-divergence[20].
- Kullback–Leibler divergence's ScienceDirect topic ID is recorded as mathematics/kullback-leibler-divergence[21].
- Kullback–Leibler divergence's ScienceDirect topic ID is recorded as social-sciences/kullback-leibler-divergence[22].
- Kullback–Leibler divergence's ScienceDirect topic ID is recorded as computer-science/leibler-divergence[23].
Why It Matters
Kullback–Leibler divergence draws 1,659 Wikipedia views per month (f_divergence category, ranking #1 of 1).[2] It has Wikipedia articles in 19 language editions, a strong signal of global cultural recognition.[24] It is known by 12 alternative names across languages and contexts.[25]