Logarithmic divergences from optimal transport and RΓ©nyi geometry
December 10, 2017 Β· Declared Dead Β· π Information Geometry
"No code URL or promise found in abstract"
Evidence collected by the PWNC Scanner
Authors
Ting-Kam Leonard Wong
arXiv ID
1712.03610
Category
math.PR
Cross-listed
cs.IT,
math.ST
Citations
52
Venue
Information Geometry
Last Checked
5 months ago
Abstract
Divergences, also known as contrast functions, are distance-like quantities defined on manifolds of non-negative or probability measures. Using the duality in optimal transport, we introduce and study the one-parameter family of $L^{(\pm Ξ±)}$-divergences. It includes the Bregman divergence corresponding to the Euclidean quadratic cost, and the $L$-divergence introduced by Pal and the author in connection with portfolio theory and a logarithmic cost function. They admit natural generalizations of exponential family that are closely related to the $Ξ±$-family and $q$-exponential family. In particular, the $L^{(\pm Ξ±)}$-divergences of the corresponding potential functions are RΓ©nyi divergences. Using this unified framework we prove that the induced geometries are dually projectively flat with constant sectional curvatures, and a generalized Pythagorean theorem holds true. Conversely, we show that if a statistical manifold is dually projectively flat with constant curvature $\pm Ξ±$ with $Ξ±> 0$, then it is locally induced by an $L^{(\mp Ξ±)}$-divergence. We define in this context a canonical divergence which extends the one for dually flat manifolds.
Community Contributions
Found the code? Know the venue? Think something is wrong? Let us know!
π Similar Papers
In the same crypt β math.PR
R.I.P.
π»
Ghosted
π
π
The Cartographer
An Introduction to Matrix Concentration Inequalities
R.I.P.
π»
Ghosted
Non-backtracking spectrum of random graphs: community detection and non-regular Ramanujan graphs
R.I.P.
π»
Ghosted
Convergence of the Deep BSDE Method for Coupled FBSDEs
R.I.P.
π»
Ghosted
A Random Matrix Approach to Neural Networks
R.I.P.
π»
Ghosted
Concentration and regularization of random graphs
Died the same way β π» Ghosted
R.I.P.
π»
Ghosted
Federated Learning: Strategies for Improving Communication Efficiency
R.I.P.
π»
Ghosted
In-Datacenter Performance Analysis of a Tensor Processing Unit
R.I.P.
π»
Ghosted
Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning
R.I.P.
π»
Ghosted