KwaiYiiMath: Technical Report

Jiayi Fu, Lei Lin, Xiaoyang Gao, Pengli Liu, Zhengzong Chen +16 more
10/11/2023
cs.CLcs.AIcs.LG

No confident code implementation found for this paper.

Abstract

Recent advancements in large language models (LLMs) have demonstrated remarkable abilities in handling a variety of natural language processing (NLP) downstream tasks, even on mathematical tasks requiring multi-step reasoning. In this report, we introduce the KwaiYiiMath which enhances the mathematical reasoning abilities of KwaiYiiBase1, by applying Supervised Fine-Tuning (SFT) and Reinforced Learning from Human Feedback (RLHF), including on both English and Chinese mathematical tasks. Meanwhile, we also constructed a small-scale Chinese primary school mathematics test set (named KMath), consisting of 188 examples to evaluate the correctness of the problem-solving process generated by the models. Empirical studies demonstrate that KwaiYiiMath can achieve state-of-the-art (SOTA) performance on GSM8k, CMath, and KMath compared with the similar size models, respectively.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Cite this paper

@article{fu2023kwaiyiimath,
  title  = {KwaiYiiMath: Technical Report},
  author = {Jiayi Fu and Lei Lin and Xiaoyang Gao and Pengli Liu and Zhengzong Chen and Zhirui Yang and Shengnan Zhang and Xue Zheng and Yan Li and Yuliang Liu and Xucheng Ye and Yiqiao Liao and Chao Liao and Bin Chen and Chengru Song and Junchen Wan and Zijia Lin and Fuzheng Zhang and Zhongyuan Wang and Di Zhang and Kun Gai},
  year   = {2023},
  eprint = {2310.07488},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2310.07488v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2310.07488.svg)](https://codeofpaper.com/paper/2310.07488)

Discussion