DreamReasoner-8B: Block-Size Curriculum Learning for Diffusion Reasoning Models

Zirui Wu, Lin Zheng, Jiacheng Ye, Shansan Gong, Xueliang Zhao +3 more
6/17/2026
cs.CL

Official code: DreamLM/DreamReasoner (17 stars, Apache-2.0, last commit 2026-06-18).

Abstract

Block diffusion language models accelerate decoding through parallel block-wise denoising, yet whether they can be reliably scaled for long chain-of-thought (CoT) reasoning remains unresolved. To this end, we develop DreamReasoner-8B, an open-source block diffusion reasoning model, and conduct a systematic study of how training and inference block sizes affect long-CoT reasoning. Our analysis reveals a stark performance disparity: training with large block sizes yields remarkably poor reasoning, whereas small block sizes preserve effective reasoning. To bridge this granularity gap, we propose block-size curriculum learning, which gradually transitions training from fine-grained to coarse-grained block sizes, thereby overcoming this limitation and enabling strong reasoning performance that generalizes across diverse inference block sizes. On mathematical and code reasoning benchmarks, DreamReasoner-8B achieves results competitive with leading open autoregressive models such as Qwen3-8B. This work establishes a practical foundation for efficient, reasoning-capable diffusion language models. We release our model at https://github.com/DreamLM/DreamReasoner.

View on arXivView PDF

Code Implementations(1)

Apache-2.0

DreamReasoner-8B, a large diffusion reasoning model

170Jun 17, 20264 months agoApache-2.0

Similar Papers

Cite this paper

@article{wu2026dreamreasonerb,
  title  = {DreamReasoner-8B: Block-Size Curriculum Learning for Diffusion Reasoning Models},
  author = {Zirui Wu and Lin Zheng and Jiacheng Ye and Shansan Gong and Xueliang Zhao and Yansong Feng and Wei Bi and Lingpeng Kong},
  year   = {2026},
  eprint = {2606.19257},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2606.19257v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2606.19257.svg)](https://codeofpaper.com/paper/2606.19257)

Discussion