Towards Optimal Caching and Model Selection for Large Model Inference

Banghua Zhu, Ying Sheng, Lianmin Zheng, Clark W. Barrett, Michael I. Jordan +1 more
2/12/2026

No confident code implementation found for this paper. 1 possible match can be shown below.

Semantic Scholar

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Cite this paper

@article{zhu2026towards,
  title  = {Towards Optimal Caching and Model Selection for Large Model Inference},
  author = {Banghua Zhu and Ying Sheng and Lianmin Zheng and Clark W. Barrett and Michael I. Jordan and Jiantao Jiao},
  year   = {2026},
  url    = {https://api.semanticscholar.org/CorpusID:8f9e0c60a1f2f4c5a62b7561834f02848ce8069f},
  journal = {NEURIPS 2023 2023}
}

Discussion