EdaCSC: Two Easy Data Augmentation Methods for Chinese Spelling Correction

Lei Sheng, Shuai-Shuai Xu
9/8/2024
cs.CLcs.AI

No confident code implementation found for this paper.

Abstract

Chinese Spelling Correction (CSC) aims to detect and correct spelling errors in Chinese sentences caused by phonetic or visual similarities. While current CSC models integrate pinyin or glyph features and have shown significant progress,they still face challenges when dealing with sentences containing multiple typos and are susceptible to overcorrection in real-world scenarios. In contrast to existing model-centric approaches, we propose two data augmentation methods to address these limitations. Firstly, we augment the dataset by either splitting long sentences into shorter ones or reducing typos in sentences with multiple typos. Subsequently, we employ different training processes to select the optimal model. Experimental evaluations on the SIGHAN benchmarks demonstrate the superiority of our approach over most existing models, achieving state-of-the-art performance on the SIGHAN15 test set.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{sheng2024edacsc,
  title  = {EdaCSC: Two Easy Data Augmentation Methods for Chinese Spelling Correction},
  author = {Lei Sheng and Shuai-Shuai Xu},
  year   = {2024},
  eprint = {2409.05105},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2409.05105v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2409.05105.svg)](https://codeofpaper.com/paper/2409.05105)

Discussion