Functional Interpolation for Relative Positions Improves Long Context Transformers

Shanda Li, Chong You, Guru Guruganesh, J. Ainslie, Santiago Ontanon +5 more
2/12/2026
DOISemantic Scholar

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Cite this paper

@article{li2026functional,
  title  = {Functional Interpolation for Relative Positions Improves Long Context Transformers},
  author = {Shanda Li and Chong You and Guru Guruganesh and J. Ainslie and Santiago Ontanon and M. Zaheer and Sumit K. Sanghai and Yiming Yang and Sanjiv Kumar and Srinadh Bhojanapalli},
  year   = {2026},
  doi    = {10.48550/arXiv.2310.04418},
  url    = {https://doi.org/10.48550/arXiv.2310.04418},
  journal = {ICLR 2024 2024}
}

Discussion