A Light Discussion and Derivation of Entropy

Jonathon Shlens

The expression for entropy sometimes appears mysterious - as it often is asserted without justification. This short manuscript contains a discussion of the underlying assumptions behind entropy as well as simple derivation of this ubiquitous quantity.

Knowledge Graph

arrow_drop_up

Comments

Sign up or login to leave a comment