Jamba: Hybrid Transformer-Mamba Language Models

Barak Lenz, Opher Lieber, Alan Arazi, Amir Bergman, Avshalom Manevich +16 more
2/12/2026

No official code found. Best implementation: kyegomez/Jamba (214 stars, MIT, last commit 2026-04-13).

Semantic Scholar

Code Implementations(1)

kyegomez/JambaCommunity72%
MIT

PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"

21415Shell, PythonApr 1, 20246 months agoMIT
aiartificial-neural-networksattention-is-all-you-needattention-mechanismattention-mechanisms+4 more

Cite this paper

@article{lenz2026jamba,
  title  = {Jamba: Hybrid Transformer-Mamba Language Models},
  author = {Barak Lenz and Opher Lieber and Alan Arazi and Amir Bergman and Avshalom Manevich and Barak Peleg and Ben Aviram and Chen Almagor and Clara Fridman and Dan Padnos and Daniel Gissin and Daniel Jannai and Dor Muhlgay and Dor Zimberg and E. Gerber and Elad Dolev and Eran Krakovsky and Erez Safahi and Erez Schwartz and Gal Cohen and et al.},
  year   = {2026},
  url    = {https://api.semanticscholar.org/CorpusID:dccaa70c2e17f35c3e07b78721e7fb8b59f61f64},
  journal = {ICLR 2025 2025}
}

Discussion