Speculative Knowledge Distillation: Bridging the Teacher-Student Gap Through Interleaved Sampling

Wenda Xu, Rujun Han, Zifeng Wang, Long T. Le, Dhruv Madeka +5 more
2/12/2026

No confident code implementation found for this paper.

Semantic Scholar

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Cite this paper

@article{xu2026speculative,
  title  = {Speculative Knowledge Distillation: Bridging the Teacher-Student Gap Through Interleaved Sampling},
  author = {Wenda Xu and Rujun Han and Zifeng Wang and Long T. Le and Dhruv Madeka and Lei Li and William Yang Wang and Rishabh Agarwal and Chen-Yu Lee and Tomas Pfister},
  year   = {2026},
  url    = {https://api.semanticscholar.org/CorpusID:a4990b9c01c5354601c122c92f0438f24cf124ad},
  journal = {ICLR 2025 2025}
}

Discussion