Word Segmentation for Asian Languages: Chinese, Korean, and Japanese

Matthew Rho, Yexin Tian, Qin Chen
7/28/2024
cs.CL

No confident code implementation found for this paper.

Abstract

We provide a detailed overview of various approaches to word segmentation of Asian Languages, specifically Chinese, Korean, and Japanese languages. For each language, approaches to deal with word segmentation differs. We also include our analysis about certain advantages and disadvantages to each method. In addition, there is room for future work in this field.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Parsing Through Boundaries in Chinese Word Segmentation

84% match2025

PKUSEG: A Toolkit for Multi-Domain Chinese Word Segmentation

77% match1 repo6.7k2019

Cross-lingual Word Segmentation and Morpheme Segmentation as Sequence Labelling

77% match1 repo352017

BabyLM's First Words: Word Segmentation as a Phonological Probing Task

77% match2025

Word segmentation granularity in Korean

76% match2023

Mining Word Boundaries from Speech-Text Parallel Data for Cross-domain Chinese Word Segmentation

76% match1 repo12024

Cite this paper

@article{rho2024word,
  title  = {Word Segmentation for Asian Languages: Chinese, Korean, and Japanese},
  author = {Matthew Rho and Yexin Tian and Qin Chen},
  year   = {2024},
  eprint = {2407.19400},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2407.19400v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2407.19400.svg)](https://codeofpaper.com/paper/2407.19400)

Discussion