OLMoE: Open Mixture-of-Experts Language Models

Niklas Muennighoff, Luca Soldaini, Dirk Groeneveld, Kyle Lo, Jacob Daniel Morrison +16 more
2/12/2026

No official code found. Best implementation: allenai/OLMoE (1,091 stars, Apache-2.0, last commit 2025-09-23).

Semantic Scholar

Code Implementations(1)

allenai/OLMoECommunity67%
Apache-2.0

OLMoE: Open Mixture-of-Experts Language Models

1,091122Shell, PythonJun 22, 20241 years agoApache-2.0

Similar Papers

Cite this paper

@article{muennighoff2026olmoe,
  title  = {OLMoE: Open Mixture-of-Experts Language Models},
  author = {Niklas Muennighoff and Luca Soldaini and Dirk Groeneveld and Kyle Lo and Jacob Daniel Morrison and Sewon Min and Weijia Shi and E. Walsh and Oyvind Tafjord and Nathan Lambert and Yuling Gu and Shane Arora and Akshita Bhagia and Dustin Schwenk and David Wadden and Alexander Wettig and Binyuan Hui and Tim Dettmers and Douwe Kiela and Ali Farhadi and et al.},
  year   = {2026},
  url    = {https://api.semanticscholar.org/CorpusID:278b2ba86def9e21c0b239474e5df3ddb7ce1ab2},
  journal = {ICLR 2025 2025}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/278b2ba86def9e21c0b239474e5df3ddb7ce1ab2.svg)](https://codeofpaper.com/paper/278b2ba86def9e21c0b239474e5df3ddb7ce1ab2)

Discussion