Open Access Senior Honors Thesis
Dr. Ovidiu Calin
Dr. Kemper Moreland
This thesis is a formal presentation of entropy and related principles as they relate to probability theory. The central focus is on the mathematical definition of entropy, and on methods for obtaining maximum entropy distributions. Transformations which preserve the entropy of a probability density function are also developed. Entropy is a measure of uncertainty, and a maximum entropy distributions has the desirable property of maximizing uncertainty for all unknown information of a given phenomenon.
Williams, Jonathan P., "Entropy and Related Principles" (2012). Senior Honors Theses. 303.