What about em? How Commercial Machine Translation Fails to Handle (Neo-)Pronouns

Anne Lauscher, Debora Nozza, Archie Crowley, Ehm Miltersen, Dirk Hovy
5/25/2023
cs.CLcs.AIcs.CY

No confident code implementation found for this paper. 1 possible match can be shown below.

Abstract

As 3rd-person pronoun usage shifts to include novel forms, e.g., neopronouns, we need more research on identity-inclusive NLP. Exclusion is particularly harmful in one of the most popular NLP applications, machine translation (MT). Wrong pronoun translations can discriminate against marginalized groups, e.g., non-binary individuals (Dev et al., 2021). In this ``reality check'', we study how three commercial MT systems translate 3rd-person pronouns. Concretely, we compare the translations of gendered vs. gender-neutral pronouns from English to five other languages (Danish, Farsi, French, German, Italian), and vice versa, from Danish to English. Our error analysis shows that the presence of a gender-neutral pronoun often leads to grammatical and semantic translation errors. Similarly, gender neutrality is often not preserved. By surveying the opinions of affected native speakers from diverse languages, we provide recommendations to address the issue in future MT research.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

ChatGPT Perpetuates Gender Bias in Machine Translation and Ignores Non-Gendered Pronouns: Findings across Bengali and Five other Low-Resource Languages

88% match2023

Tokenization Matters: Navigating Data-Scarce Tokenization for Gender Inclusive Language Technologies

87% match2023

MISGENDERED: Limits of Large Language Models in Understanding Pronouns

87% match2023

A Survey on Zero Pronoun Translation

87% match2023

"I'm" Lost in Translation: Pronoun Missteps in Crowdsourced Data Sets

85% match2023

Hi Guys or Hi Folks? Benchmarking Gender-Neutral Machine Translation with the GeNTE Corpus

85% match1 repo42023

Cite this paper

@article{lauscher2023what,
  title  = {What about em? How Commercial Machine Translation Fails to Handle (Neo-)Pronouns},
  author = {Anne Lauscher and Debora Nozza and Archie Crowley and Ehm Miltersen and Dirk Hovy},
  year   = {2023},
  eprint = {2305.16051},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2305.16051v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2305.16051.svg)](https://codeofpaper.com/paper/2305.16051)

Discussion