Homotopical Entropy

We present a "homotopification" of fundamental concepts from information theory. Using homotopy type theory, we define homotopy types that behave analogously to probability spaces, random variables, and the exponentials of Shannon entropy and relative entropy. The original analytic theories emerge through homotopy cardinality, which maps homotopy types to real numbers and generalizes the cardinality of sets.