Accelerating Iterative Retrieval-augmented Language Model Serving with Speculation

Zhihao Zhang, Alan Zhu, Lijie Yang, Yihua Xu, Lanting Li +2 more
2/12/2026
Semantic Scholar

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Cite this paper

@article{zhang2026accelerating,
  title  = {Accelerating Iterative Retrieval-augmented Language Model Serving with Speculation},
  author = {Zhihao Zhang and Alan Zhu and Lijie Yang and Yihua Xu and Lanting Li and P. Phothilimthana and Zhihao Jia},
  year   = {2026},
  url    = {https://api.semanticscholar.org/CorpusID:d3389f9e362c74d50ee8021d67b9711805d7054d},
  journal = {ICML 2024 2024}
}

Discussion