Token Statistics Transformer: Linear-Time Attention via Variational Rate Reduction

Ziyang Wu, Tianjiao Ding, Yifu Lu, Druv Pai, Jingyuan Zhang +4 more
2/12/2026

No confident code implementation found for this paper. 1 possible match can be shown below.

Semantic Scholar

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Cite this paper

@article{wu2026token,
  title  = {Token Statistics Transformer: Linear-Time Attention via Variational Rate Reduction},
  author = {Ziyang Wu and Tianjiao Ding and Yifu Lu and Druv Pai and Jingyuan Zhang and Weida Wang and Yaodong Yu and Yi Ma and B. Haeffele},
  year   = {2026},
  url    = {https://api.semanticscholar.org/CorpusID:c825a26094701d1a81ac6486f70fd4e718082f2b},
  journal = {ICLR 2025 2025}
}

Discussion