Weak Poincarรฉ Inequalities, Simulated Annealing, and Sampling from Spherical Spin Glasses
November 13, 2024 ยท Declared Dead ยท ๐ Symposium on the Theory of Computing
"No code URL or promise found in abstract"
Evidence collected by the PWNC Scanner
Authors
Brice Huang, Sidhanth Mohanty, Amit Rajaraman, David X. Wu
arXiv ID
2411.09075
Category
math.PR
Cross-listed
cond-mat.dis-nn,
cs.DS,
math-ph
Citations
12
Venue
Symposium on the Theory of Computing
Last Checked
4 months ago
Abstract
There has been a recent surge of powerful tools to show rapid mixing of Markov chains, via functional inequalities such as Poincarรฉ inequalities. In many situations, Markov chains fail to mix rapidly from a worst-case initialization, yet are expected to approximately sample from a random initialization. For example, this occurs if the target distribution has metastable states, small clusters accounting for a vanishing fraction of the mass that are essentially disconnected from the bulk of the measure. Under such conditions, a Poincarรฉ inequality cannot hold, necessitating new tools to prove sampling guarantees. We develop a framework to analyze simulated annealing, based on establishing so-called weak Poincarรฉ inequalities. These inequalities imply mixing from a suitably warm start, and simulated annealing provides a way to chain such warm starts together into a sampling algorithm. We further identify a local-to-global principle to prove weak Poincarรฉ inequalities, mirroring the spectral independence and localization schemes frameworks for analyzing mixing times of Markov chains. As our main application, we prove that simulated annealing samples from the Gibbs measure of a spherical spin glass for inverse temperatures up to a natural threshold, matching recent algorithms based on algorithmic stochastic localization. This provides the first Markov chain sampling guarantee that holds beyond the uniqueness threshold for spherical spin glasses, where mixing from a worst-case initialization is provably slow due to the presence of metastable states. As an ingredient in our proof, we prove bounds on the operator norm of the covariance matrix of spherical spin glasses in the full replica-symmetric regime. Additionally, we resolve a question related to sampling using data-based initializations.
Community Contributions
Found the code? Know the venue? Think something is wrong? Let us know!
๐ Similar Papers
In the same crypt โ math.PR
R.I.P.
๐ป
Ghosted
๐
๐
The Cartographer
An Introduction to Matrix Concentration Inequalities
R.I.P.
๐ป
Ghosted
Non-backtracking spectrum of random graphs: community detection and non-regular Ramanujan graphs
R.I.P.
๐ป
Ghosted
Convergence of the Deep BSDE Method for Coupled FBSDEs
R.I.P.
๐ป
Ghosted
A Random Matrix Approach to Neural Networks
R.I.P.
๐ป
Ghosted
Concentration and regularization of random graphs
Died the same way โ ๐ป Ghosted
R.I.P.
๐ป
Ghosted
Federated Learning: Strategies for Improving Communication Efficiency
R.I.P.
๐ป
Ghosted
In-Datacenter Performance Analysis of a Tensor Processing Unit
R.I.P.
๐ป
Ghosted
Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning
R.I.P.
๐ป
Ghosted