HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledge

Haochun Wang, Chi Liu, Nuwa Xi, Zewen Qiang, Sendong Zhao +2 more
4/14/2023
cs.CL

Official code: SCIR-HI/Huatuo-Llama-Med-Chinese (4,986 stars, Apache-2.0, last commit 2026-04-14).

Abstract

Large Language Models (LLMs), such as the LLaMA model, have demonstrated their effectiveness in various general-domain natural language processing (NLP) tasks. Nevertheless, LLMs have not yet performed optimally in biomedical domain tasks due to the need for medical expertise in the responses. In response to this challenge, we propose HuaTuo, a LLaMA-based model that has been supervised-fine-tuned with generated QA (Question-Answer) instances. The experimental results demonstrate that HuaTuo generates responses that possess more reliable medical knowledge. Our proposed HuaTuo model is accessible at https://github.com/SCIR-HI/Huatuo-Llama-Med-Chinese.

View on arXivView PDF

Code Implementations(1)

SCIR-HI/Huatuo-Llama-Med-ChineseOfficial100%
Apache-2.0

Repo for BenCao [original name: HuaTuo (华驼)], Instruction-tuning Large Language Models with Chinese Medical Knowledge. 本草（原名：华驼）模型仓库，基于中文医学知识的大语言模型指令微调

4,986498Shell, PythonMar 31, 20236 months agoApache-2.0
aidoctorbloomchinesehuozillama+5 more

Similar Papers

BioInstruct: Instruction Tuning of Large Language Models for Biomedical Natural Language Processing

88% match1 repo62023

DrBERT: A Robust Pre-trained Model in French for Biomedical and Clinical domains

88% match1 repo222023

IvyGPT: InteractiVe Chinese pathwaY language model in medical domain

88% match1 repo572023

ChiMed-GPT: A Chinese Medical Large Language Model with Full Training Regime and Better Alignment to Human Preferences

87% match1 repo1072023

ClinicalGPT: Large Language Models Finetuned with Diverse Medical Data and Comprehensive Evaluation

87% match2023

PMC-LLaMA: Towards Building Open-source Language Models for Medicine

87% match1 repo6802023

Cite this paper

@article{wang2023huatuo,
  title  = {HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledge},
  author = {Haochun Wang and Chi Liu and Nuwa Xi and Zewen Qiang and Sendong Zhao and Bing Qin and Ting Liu},
  year   = {2023},
  eprint = {2304.06975},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2304.06975v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2304.06975.svg)](https://codeofpaper.com/paper/2304.06975)

Discussion