Cross-Dialect Sentence Transformation: A Comparative Analysis of Language Models for Adapting Sentences to British English

Shruti Dutta, Shashwat Mookherjee
11/5/2023
cs.CLcs.AI

No confident code implementation found for this paper.

Abstract

This study explores linguistic distinctions among American, Indian, and Irish English dialects and assesses various Language Models (LLMs) in their ability to generate British English translations from these dialects. Using cosine similarity analysis, the study measures the linguistic proximity between original British English translations and those produced by LLMs for each dialect. The findings reveal that Indian and Irish English translations maintain notably high similarity scores, suggesting strong linguistic alignment with British English. In contrast, American English exhibits slightly lower similarity, reflecting its distinct linguistic traits. Additionally, the choice of LLM significantly impacts translation quality, with Llama-2-70b consistently demonstrating superior performance. The study underscores the importance of selecting the right model for dialect translation, emphasizing the role of linguistic expertise and contextual understanding in achieving accurate translations.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{dutta2023crossdialect,
  title  = {Cross-Dialect Sentence Transformation: A Comparative Analysis of Language Models for Adapting Sentences to British English},
  author = {Shruti Dutta and Shashwat Mookherjee},
  year   = {2023},
  eprint = {2311.07583},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2311.07583v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2311.07583.svg)](https://codeofpaper.com/paper/2311.07583)

Discussion