Lowering the Pre-training Tax for Gradient-based Subset Training: A Lightweight Distributed Pre-Training Toolkit

Yeonju Ro, Zhangyang Wang, Vijay Chidambaram, Aditya Akella
2/12/2026
Semantic Scholar

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Cite this paper

@article{ro2026lowering,
  title  = {Lowering the Pre-training Tax for Gradient-based Subset Training: A Lightweight Distributed Pre-Training Toolkit},
  author = {Yeonju Ro and Zhangyang Wang and Vijay Chidambaram and Aditya Akella},
  year   = {2026},
  url    = {https://api.semanticscholar.org/CorpusID:df818dcc5bd9405b50c377796ac0ed0295937125},
  journal = {ICML 2023 2023}
}

Discussion