Low-Rank Approximation for Sparse Attention in Multi-Modal LLMs

Lin Song, Yukang Chen, Shuai Yang, Xiaohan Ding, Yixiao Ge +2 more
2/9/2026
DOISemantic Scholar

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 2 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Cite this paper

@article{song2026lowrank,
  title  = {Low-Rank Approximation for Sparse Attention in Multi-Modal LLMs},
  author = {Lin Song and Yukang Chen and Shuai Yang and Xiaohan Ding and Yixiao Ge and Ying-Cong Chen and Ying Shan},
  year   = {2026},
  doi    = {10.1109/CVPR52733.2024.01306},
  url    = {https://doi.org/10.1109/CVPR52733.2024.01306},
  journal = {CVPR 2024 2024}
}

Discussion