MMSE of probabilistic low-rank matrix estimation: Universality with respect to the output channel

July 14, 2015 Β· Declared Dead Β· πŸ› Allerton Conference on Communication, Control, and Computing

πŸ‘» CAUSE OF DEATH: Ghosted
No code link whatsoever

"No code URL or promise found in abstract"

Evidence collected by the PWNC Scanner

Authors Thibault Lesieur, Florent Krzakala, Lenka ZdeborovΓ‘ arXiv ID 1507.03857 Category cs.IT: Information Theory Cross-listed cond-mat.stat-mech, stat.ML Citations 115 Venue Allerton Conference on Communication, Control, and Computing Last Checked 4 months ago
Abstract
This paper considers probabilistic estimation of a low-rank matrix from non-linear element-wise measurements of its elements. We derive the corresponding approximate message passing (AMP) algorithm and its state evolution. Relying on non-rigorous but standard assumptions motivated by statistical physics, we characterize the minimum mean squared error (MMSE) achievable information theoretically and with the AMP algorithm. Unlike in related problems of linear estimation, in the present setting the MMSE depends on the output channel only trough a single parameter - its Fisher information. We illustrate this striking finding by analysis of submatrix localization, and of detection of communities hidden in a dense stochastic block model. For this example we locate the computational and statistical boundaries that are not equal for rank larger than four.
Community shame:
Not yet rated
Community Contributions

Found the code? Know the venue? Think something is wrong? Let us know!

πŸ“œ Similar Papers

In the same crypt β€” Information Theory

Died the same way β€” πŸ‘» Ghosted