Mixture of Hidden-Dimensions: Not All Hidden-States' Dimensions are Needed in Transformer

Yilong Chen, Junyuan Shang, Zhenyu Zhang, Jiawei Sheng, Tingwen Liu +4 more
2/14/2026

No confident code implementation found for this paper.

Semantic Scholar

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Cite this paper

@article{chen2026mixture,
  title  = {Mixture of Hidden-Dimensions: Not All Hidden-States' Dimensions are Needed in Transformer},
  author = {Yilong Chen and Junyuan Shang and Zhenyu Zhang and Jiawei Sheng and Tingwen Liu and Shuohuan Wang and Yu Sun and Hua Wu and Haifeng Wang},
  year   = {2026},
  url    = {https://api.semanticscholar.org/CorpusID:7a7cdb6704c18a60cfa85a0381077dd4b9ccc61c},
  journal = {ICML 2025 2025}
}

Discussion