Settings

Theme

Entropy of a Mixture

cgad.ski

54 points by cgadski 6 months ago · 5 comments

Reader

mreid 6 months ago

Really nice presentation of divergences. I made a similar attempt (math + interactive JS visualizations) a long time ago for the Bregman divergences: https://mark.reid.name/blog/meet-the-bregman-divergences.htm...

These visualizations are much nicer than mine though.

Curious fact, the Bregman divergences are a different class of divergences to the f-divergences that intersect at the KL divergence. That is, KL is (essentially) the only divergence that is both an f-divergence and a Bregman divergence. This is basically because log turns a ratio into a difference.

esafak 6 months ago

Forgive the meta comment, but is the source for your blog template available? I admire the presentation.

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection