The Cost of Scaling Down Large Language Models: Reducing Model Size Affects Memory before In-context Learning

Tian Jin, Nolan Clement, Xin Dong, Vaishnavh Nagarajan, Michael Carbin +2 more
2/12/2026

No confident code implementation found for this paper. 1 possible match can be shown below.

Semantic Scholar

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Revisiting Chain-of-Thought in Code Generation: Do Language Models Need to Learn Reasoning before Coding?

84% match2026

What Makes In-context Learning Effective for Mathematical Reasoning

82% match2026

HELMET: How to Evaluate Long-context Models Effectively and Thoroughly

76% match2026

WeatherGFM: Learning a Weather Generalist Foundation Model via In-context Learning

72% match1 repo122026

MissScore: High-Order Score Estimation in the Presence of Missing Data

70% match2026

Turning the Curse of Heterogeneity in Federated Learning into a Blessing for Out-of-Distribution Detection

67% match2026

Cite this paper

@article{jin2026cost,
  title  = {The Cost of Scaling Down Large Language Models: Reducing Model Size Affects Memory before In-context Learning},
  author = {Tian Jin and Nolan Clement and Xin Dong and Vaishnavh Nagarajan and Michael Carbin and Jonathan Ragan-Kelley and G. Dziugaite},
  year   = {2026},
  url    = {https://api.semanticscholar.org/CorpusID:580adeb02b95a74d4e33c25747b0d4c629f54baf},
  journal = {ICLR 2024 2024}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/580adeb02b95a74d4e33c25747b0d4c629f54baf.svg)](https://codeofpaper.com/paper/580adeb02b95a74d4e33c25747b0d4c629f54baf)

Discussion