Unifying AMP Algorithms for Rotationally-Invariant Models

Songbin Liu, Junjie Ma
12/2/2024
math.STcs.ITcs.LG

No confident code implementation found for this paper. 2 possible matches can be shown below.

Abstract

This paper presents a unified framework for constructing Approximate Message Passing (AMP) algorithms for rotationally-invariant models. By employing a general iterative algorithm template and reducing it to long-memory Orthogonal AMP (OAMP), we systematically derive the correct Onsager terms of AMP algorithms. This approach allows us to rederive an AMP algorithm introduced by Fan and Opper et al., while shedding new light on the role of free cumulants of the spectral law. The free cumulants arise naturally from a recursive centering operation, potentially of independent interest beyond the scope of AMP. To illustrate the flexibility of our framework, we introduce two novel AMP variants and apply them to estimation in spiked models.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 2 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Orthogonal Approximate Message Passing with Optimal Spectral Initializations for Rectangular Spiked Matrix Models

83% match2025

Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noise

78% match1 repo2024

Semidefinite programs simulate approximate message passing robustly

78% match2023

Optimal Algorithms for the Inhomogeneous Spiked Wigner Model

77% match2023

Optimal Estimation in Orthogonally Invariant Generalized Linear Models: Spectral Initialization and Approximate Message Passing

75% match2026

Rotary Positional Embeddings as Phase Modulation: Theoretical Bounds on the RoPE Base for Long-Context Transformers

75% match2026

Cite this paper

@article{liu2024unifying,
  title  = {Unifying AMP Algorithms for Rotationally-Invariant Models},
  author = {Songbin Liu and Junjie Ma},
  year   = {2024},
  eprint = {2412.01574},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2412.01574v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2412.01574.svg)](https://codeofpaper.com/paper/2412.01574)

Discussion