Large language models transition from integrating across position-yoked, exponential windows to structure-yoked, power-law windows

David Skrill, Samuel Norman-Haignere
2/12/2026

No confident code implementation found for this paper. 1 possible match can be shown below.

DOISemantic Scholar

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Cite this paper

@article{skrill2026large,
  title  = {Large language models transition from integrating across position-yoked, exponential windows to structure-yoked, power-law windows},
  author = {David Skrill and Samuel Norman-Haignere},
  year   = {2026},
  doi    = {10.52202/075280-0030},
  url    = {https://doi.org/10.52202/075280-0030},
  journal = {NEURIPS 2023 2023}
}

Discussion