Offensive Language Identification in Transliterated and Code-Mixed Bangla

Md Nishat Raihan, Umma Hani Tanmoy, Anika Binte Islam, Kai North, Tharindu Ranasinghe +2 more
11/25/2023
cs.CL

No confident code implementation found for this paper. 1 possible match can be shown below.

Abstract

Identifying offensive content in social media is vital for creating safe online communities. Several recent studies have addressed this problem by creating datasets for various languages. In this paper, we explore offensive language identification in texts with transliterations and code-mixing, linguistic phenomena common in multilingual societies, and a known challenge for NLP systems. We introduce TB-OLID, a transliterated Bangla offensive language dataset containing 5,000 manually annotated comments. We train and fine-tune machine learning models on TB-OLID, and we evaluate their results on this dataset. Our results show that English pre-trained transformer-based models, such as fBERT and HateBERT achieve the best performance on this dataset.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Offensive Hebrew Corpus and Detection using BERT

90% match1 repo42023

A Text-to-Text Model for Multilingual Offensive Language Identification

89% match2023

Developing Linguistic Patterns to Mitigate Inherent Human Bias in Offensive Language Detection

88% match1 repo72023

Detection and Analysis of Offensive Online Content in Hausa Language

87% match1 repo2023

The performance of multiple language models in identifying offensive language on social media

87% match2023

Content-Localization based System for Analyzing Sentiment and Hate Behaviors in Low-Resource Dialectal Arabic: English to Levantine and Gulf

86% match2023

Cite this paper

@article{raihan2023offensive,
  title  = {Offensive Language Identification in Transliterated and Code-Mixed Bangla},
  author = {Md Nishat Raihan and Umma Hani Tanmoy and Anika Binte Islam and Kai North and Tharindu Ranasinghe and Antonios Anastasopoulos and Marcos Zampieri},
  year   = {2023},
  eprint = {2311.15023},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2311.15023v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2311.15023.svg)](https://codeofpaper.com/paper/2311.15023)

Discussion