InCoder-32B: Code Foundation Model for Industrial Scenarios

Jian Yang, Wei Zhang, Jiajun Wu, Junhang Cheng, Shawn Guo +23 more
3/17/2026
cs.SEcs.AI

No official code found. Best implementation: nktkt/hf-paper-2026-03-incoder-32b-code-foundation-model-for-indu (1 star, last commit 2026-03-25).

Abstract

Recent code large language models have achieved remarkable progress on general programming tasks. Nevertheless, their performance degrades significantly in industrial scenarios that require reasoning about hardware semantics, specialized language constructs, and strict resource constraints. To address these challenges, we introduce InCoder-32B (Industrial-Coder-32B), the first 32B-parameter code foundation model unifying code intelligence across chip design, GPU kernel optimization, embedded systems, compiler optimization, and 3D modeling. By adopting an efficient architecture, we train InCoder-32B from scratch with general code pre-training, curated industrial code annealing, mid-training that progressively extends context from 8K to 128K tokens with synthetic industrial reasoning data, and post-training with execution-grounded verification. We conduct extensive evaluation on 14 mainstream general code benchmarks and 9 industrial benchmarks spanning 4 specialized domains. Results show InCoder-32B achieves highly competitive performance on general tasks while establishing strong open-source baselines across industrial domains.

View on arXivView PDF

Code Implementations(1)

Inference and evaluation framework for InCoder-32B: Code Foundation Model for Industrial Scenarios (arXiv 2603.16790)

10PythonMar 25, 20266 months ago

Similar Papers

Cite this paper

@article{yang2026incoderb,
  title  = {InCoder-32B: Code Foundation Model for Industrial Scenarios},
  author = {Jian Yang and Wei Zhang and Jiajun Wu and Junhang Cheng and Shawn Guo and Haowen Wang and Weicheng Gu and Yaxin Du and Joseph Li and Fanglin Xu and Yizhi Li and Lin Jing and Yuanbo Wang and Yuhan Gao and Ruihao Gong and Chuan Hao and Ran Tao and Aishan Liu and Tuney Zheng and Ganqu Cui and Zhoujun Li and Mingjie Tang and Chenghua Lin and Wayne Xin Zhao and Xianglong Liu and Ming Zhou and Bryan Dai and Weifeng Lv},
  year   = {2026},
  eprint = {2603.16790},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2603.16790v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2603.16790.svg)](https://codeofpaper.com/paper/2603.16790)

Discussion