The Role of Sparsity for Length Generalization in LLMs

Noah Golowich, Samy Jelassi, David Brandfonbrener, S. Kakade, Eran Malach
2/14/2026
Semantic Scholar

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Cite this paper

@article{golowich2026role,
  title  = {The Role of Sparsity for Length Generalization in LLMs},
  author = {Noah Golowich and Samy Jelassi and David Brandfonbrener and S. Kakade and Eran Malach},
  year   = {2026},
  url    = {https://api.semanticscholar.org/CorpusID:db48ecbb575bbb64f89ec92de0929549429a631e},
  journal = {ICML 2025 2025}
}

Discussion