Systematic Offensive Stereotyping (SOS) Bias in Language Models

Fatma Elsafoury
8/21/2023
cs.CL

No confident code implementation found for this paper.

Abstract

In this paper, we propose a new metric to measure the SOS bias in language models (LMs). Then, we validate the SOS bias and investigate the effectiveness of removing it. Finally, we investigate the impact of the SOS bias in LMs on their performance and fairness on hate speech detection. Our results suggest that all the inspected LMs are SOS biased. And that the SOS bias is reflective of the online hate experienced by marginalized identities. The results indicate that using debias methods from the literature worsens the SOS bias in LMs for some sensitive attributes and improves it for others. Finally, Our results suggest that the SOS bias in the inspected LMs has an impact on their fairness of hate speech detection. However, there is no strong evidence that the SOS bias has an impact on the performance of hate speech detection.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Thesis Distillation: Investigating The Impact of Bias in NLP Models on Hate Speech Detection

91% match2023

Robust Hate Speech Detection in Social Media: A Cross-Dataset Empirical Evaluation

90% match2023

SEAHateCheck: Functional Tests for Detecting Hate Speech in Low-Resource Languages of Southeast Asia

89% match2026

Probing LLMs for hate speech detection: strengths and vulnerabilities

89% match2023

Evaluating the Effectiveness of Natural Language Inference for Hate Speech Detection in Languages with Limited Labeled Data

88% match2023

Bias and Fairness in Large Language Models: A Survey

87% match1 repo1622023

Cite this paper

@article{elsafoury2023systematic,
  title  = {Systematic Offensive Stereotyping (SOS) Bias in Language Models},
  author = {Fatma Elsafoury},
  year   = {2023},
  eprint = {2308.10684},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2308.10684v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2308.10684.svg)](https://codeofpaper.com/paper/2308.10684)

Discussion