Revisit the Power of Vanilla Knowledge Distillation: from Small Scale to Large Scale

Zhiwei Hao, Jianyuan Guo, Kai Han, Han Hu, Chang Xu +1 more
2/12/2026
DOISemantic Scholar

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 2 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Cite this paper

@article{hao2026revisit,
  title  = {Revisit the Power of Vanilla Knowledge Distillation: from Small Scale to Large Scale},
  author = {Zhiwei Hao and Jianyuan Guo and Kai Han and Han Hu and Chang Xu and Yunhe Wang},
  year   = {2026},
  doi    = {10.52202/075280-0444},
  url    = {https://doi.org/10.52202/075280-0444},
  journal = {NEURIPS 2023 2023}
}

Discussion