Mobile Attention: Mobile-Friendly Linear-Attention for Vision Transformers

Zhiyu Yao, Jian Wang, Haixu Wu, Jingdong Wang, Mingsheng Long
2/12/2026

No official code found. Best implementation: thuml/MobileAttention (9 stars, last commit 2024-07-19).

Semantic Scholar

Code Implementations(1)

thuml/MobileAttentionCommunity65%

Official implementation of "Mobile Attention: Mobile-Friendly Linear-Attention for Vision Transformers in PyTorch". To run the code, you can refer to https://github.com/thuml/Flowformer.

90PythonJul 17, 20242 years ago

Cite this paper

@article{yao2026mobile,
  title  = {Mobile Attention: Mobile-Friendly Linear-Attention for Vision Transformers},
  author = {Zhiyu Yao and Jian Wang and Haixu Wu and Jingdong Wang and Mingsheng Long},
  year   = {2026},
  url    = {https://api.semanticscholar.org/CorpusID:a7ff159696a988595f85b0ab6209f85dbec2d6e7},
  journal = {ICML 2024 2024}
}

Discussion