Determination of toxic comments and unintended model bias minimization using Deep learning approach

Md Azim Khan
11/8/2023
cs.LGcs.CLcs.CY

No confident code implementation found for this paper.

Abstract

Online conversations can be toxic and subjected to threats, abuse, or harassment. To identify toxic text comments, several deep learning and machine learning models have been proposed throughout the years. However, recent studies demonstrate that because of the imbalances in the training data, some models are more likely to show unintended biases including gender bias and identity bias. In this research, our aim is to detect toxic comment and reduce the unintended bias concerning identity features such as race, gender, sex, religion by fine-tuning an attention based model called BERT(Bidirectional Encoder Representation from Transformers). We apply weighted loss to address the issue of unbalanced data and compare the performance of a fine-tuned BERT model with a traditional Logistic Regression model in terms of classification and bias minimization. The Logistic Regression model with the TFIDF vectorizer achieve 57.1% accuracy, and fine-tuned BERT model's accuracy is 89%. Code is available at https://github.com/zim10/Determine_Toxic_comment_and_identity_bias.git

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Semantic and Contextual Modeling for Malicious Comment Detection with BERT-BiLSTM

87% match2025

Classification of social media Toxic comments using Machine learning models

86% match2023

A benchmark for toxic comment classification on Civil Comments dataset

85% match1 repo42023

Extended LSTM: Adaptive Feature Gating for Toxic Comment Classification

83% match2025

Vulgar Remarks Detection in Chittagonian Dialect of Bangla

83% match2023

Deep Learning Approach for Classifying the Aggressive Comments on Social Media: Machine Translated Data Vs Real Life Data

82% match2023

Cite this paper

@article{khan2023determination,
  title  = {Determination of toxic comments and unintended model bias minimization using Deep learning approach},
  author = {Md Azim Khan},
  year   = {2023},
  eprint = {2311.04789},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2311.04789v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2311.04789.svg)](https://codeofpaper.com/paper/2311.04789)

Discussion