KL(P ‖ Q)
—
KL(Q ‖ P)
—
Units
nats
bits
Distribution P
Mean
-1.0
Std
1.0
Skew
0.0
Truncate
∞
Distribution Q
Mean
1.0
Std
1.2
Skew
0.0
Truncate
∞
Discretise
off
Identical
Shifted
Q wider
Q narrower
Skewed P
Nearly disjoint
Q truncated
Coarse bins