Autoregressive Pretraining with Mamba in Vision

Sucheng Ren, Xianhang Li, Haoqin Tu, Feng Wang, Fangxun Shu +7 more
2/12/2026

No official code found. Best implementation: OliverRensu/ARM (92 stars, PyTorch, last commit 2025-05-30).

Semantic Scholar

Code Implementations(1)

OliverRensu/ARMCommunity61%
PyTorch

[ICLR2025] This repository is the official implementation of our Autoregressive Pretraining with Mamba in Vision

923PythonJun 2, 20241 years ago
autoregressivedeep-learningmambapytorch

Similar Papers

Augmenting Decision with Hypothesis in Reinforcement Learning

99% match1 repo42026

Segment Anything in 3D with NeRFs

98% match1 repo1.0k2026

Discovering Features with Synergistic Interactions in Multiple Views

98% match2026

Understanding Optimization in Deep Learning with Central Flows

97% match2026

Representation Surgery in Model Merging with Probabilistic Modeling

97% match1 repo32026

Principled Bayesian Optimization in Collaboration with Human Experts

97% match1 repo32026

Cite this paper

@article{ren2026autoregressive,
  title  = {Autoregressive Pretraining with Mamba in Vision},
  author = {Sucheng Ren and Xianhang Li and Haoqin Tu and Feng Wang and Fangxun Shu and Lei Zhang and Jieru Mei and Linjie Yang and Peng Wang and Heng Wang and Alan L. Yuille and Cihang Xie},
  year   = {2026},
  url    = {https://api.semanticscholar.org/CorpusID:02fa1f0536c461de0684bfa38503cf31e17e2555},
  journal = {ICLR 2025 2025}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/02fa1f0536c461de0684bfa38503cf31e17e2555.svg)](https://codeofpaper.com/paper/02fa1f0536c461de0684bfa38503cf31e17e2555)

Discussion