Leveraging Large Language Models for Code-Mixed Data Augmentation in Sentiment Analysis

Linda Zeng
11/1/2024
cs.CL

No official code found. Best implementation: lindazeng979/LLM-CMSA (1 star, last commit 2024-11-16).

Abstract

Code-mixing (CM), where speakers blend languages within a single expression, is prevalent in multilingual societies but poses challenges for natural language processing due to its complexity and limited data. We propose using a large language model to generate synthetic CM data, which is then used to enhance the performance of task-specific models for CM sentiment analysis. Our results show that in Spanish-English, synthetic data improved the F1 score by 9.32%, outperforming previous augmentation techniques. However, in Malayalam-English, synthetic data only helped when the baseline was low; with strong natural data, additional synthetic data offered little benefit. Human evaluation confirmed that this approach is a simple, cost-effective way to generate natural-sounding CM sentences, particularly beneficial for low baselines. Our findings suggest that few-shot prompting of large language models is a promising method for CM data augmentation and has significant impact on improving sentiment analysis, an important element in the development of social influence systems.

View on arXivView PDF

Code Implementations(1)

This repository contains datasets accompanying our paper Leveraging Large Language Models for Code-Mixed Data Augmentation in Sentiment Analysis (EMNLP '24). The datasets include both natural and synthetic data in Malayalam-English and Spanish-English.

10Oct 11, 20241 years ago

Similar Papers

Cite this paper

@article{zeng2024leveraging,
  title  = {Leveraging Large Language Models for Code-Mixed Data Augmentation in Sentiment Analysis},
  author = {Linda Zeng},
  year   = {2024},
  eprint = {2411.00691},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2411.00691v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2411.00691.svg)](https://codeofpaper.com/paper/2411.00691)

Discussion