Optimal Algorithms for the Inhomogeneous Spiked Wigner Model

Aleksandr Pak, Justin Ko, Florent Krzakala
2/13/2023
stat.MLcond-mat.dis-nncs.LG

No confident code implementation found for this paper.

Abstract

In this paper, we study a spiked Wigner problem with an inhomogeneous noise profile. Our aim in this problem is to recover the signal passed through an inhomogeneous low-rank matrix channel. While the information-theoretic performances are well-known, we focus on the algorithmic problem. We derive an approximate message-passing algorithm (AMP) for the inhomogeneous problem and show that its rigorous state evolution coincides with the information-theoretic optimal Bayes fixed-point equations. We identify in particular the existence of a statistical-to-computational gap where known algorithms require a signal-to-noise ratio bigger than the information-theoretic threshold to perform better than random. Finally, from the adapted AMP iteration we deduce a simple and efficient spectral method that can be used to recover the transition for matrices with general variance profiles. This spectral method matches the conjectured optimal computational phase transition.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{pak2023optimal,
  title  = {Optimal Algorithms for the Inhomogeneous Spiked Wigner Model},
  author = {Aleksandr Pak and Justin Ko and Florent Krzakala},
  year   = {2023},
  eprint = {2302.06665},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2302.06665v1},
  journal = {NEURIPS 2023 2023}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2302.06665.svg)](https://codeofpaper.com/paper/2302.06665)

Discussion