Analyzing Norm Violations in Live-Stream Chat

Jihyung Moon, Dong-Ho Lee, Hyundong Cho, Woojeong Jin, Chan Young Park +4 more
5/18/2023
cs.CL

No confident code implementation found for this paper. 1 possible match can be shown below.

Abstract

Toxic language, such as hate speech, can deter users from participating in online communities and enjoying popular platforms. Previous approaches to detecting toxic language and norm violations have been primarily concerned with conversations from online forums and social media, such as Reddit and Twitter. These approaches are less effective when applied to conversations on live-streaming platforms, such as Twitch and YouTube Live, as each comment is only visible for a limited time and lacks a thread structure that establishes its relationship with other comments. In this work, we share the first NLP study dedicated to detecting norm violations in conversations on live-streaming platforms. We define norm violation categories in live-stream chats and annotate 4,583 moderated comments from Twitch. We articulate several facets of live-stream data that differ from other forums, and demonstrate that existing models perform poorly in this setting. By conducting a user study, we identify the informational context humans use in live-stream moderation, and train models leveraging context to identify norm violations. Our results show that appropriate contextual information can boost moderation performance by 35\%.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

CPL-NoViD: Context-Aware Prompt-based Learning for Norm Violation Detection in Online Communities

84% match2023

Understanding and Analyzing Inappropriately Targeting Language in Online Discourse: A Comparative Annotation Study

84% match2025

Analyzing Toxicity in Deep Conversations: A Reddit Case Study

84% match2024

Defining, Understanding, and Detecting Online Toxicity: Challenges and Machine Learning Approaches

83% match2025

Silencing Empowerment, Allowing Bigotry: Auditing the Moderation of Hate Speech on Twitch

83% match1 repo2025

A Hate Speech Moderated Chat Application: Use Case for GDPR and DSA Compliance

83% match2024

Cite this paper

@article{moon2023analyzing,
  title  = {Analyzing Norm Violations in Live-Stream Chat},
  author = {Jihyung Moon and Dong-Ho Lee and Hyundong Cho and Woojeong Jin and Chan Young Park and Minwoo Kim and Jonathan May and Jay Pujara and Sungjoon Park},
  year   = {2023},
  eprint = {2305.10731},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2305.10731v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2305.10731.svg)](https://codeofpaper.com/paper/2305.10731)

Discussion