Detecting Effects of AI-Mediated Communication on Language Complexity and Sentiment

Kristen Sussman, Daniel Carter
4/28/2025
cs.CLcs.HC

No confident code implementation found for this paper.

Abstract

Given the subtle human-like effects of large language models on linguistic patterns, this study examines shifts in language over time to detect the impact of AI-mediated communication (AI- MC) on social media. We compare a replicated dataset of 970,919 tweets from 2020 (pre-ChatGPT) with 20,000 tweets from the same period in 2024, all of which mention Donald Trump during election periods. Using a combination of Flesch-Kincaid readability and polarity scores, we analyze changes in text complexity and sentiment. Our findings reveal a significant increase in mean sentiment polarity (0.12 vs. 0.04) and a shift from predominantly neutral content (54.8% in 2020 to 39.8% in 2024) to more positive expressions (28.6% to 45.9%). These findings suggest not only an increasing presence of AI in social media communication but also its impact on language and emotional expression patterns.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Measuring Social Media Polarization Using Large Language Models and Heuristic Rules

85% match1 repo32026

Polarization of Autonomous Generative AI Agents Under Echo Chambers

85% match2024

Artificial Intelligence and Civil Discourse: How LLMs Moderate Climate Change Conversations

84% match2025

Journalists, Emotions, and the Introduction of Generative AI Chatbots: A Large-Scale Analysis of Tweets Before and After the Launch of ChatGPT

84% match2024

How Large Language Models play humans in online conversations: a simulated study of the 2016 US politics on Reddit

84% match2025

Consistency of Responses and Continuations Generated by Large Language Models on Social Media

84% match2025

Cite this paper

@article{sussman2025detecting,
  title  = {Detecting Effects of AI-Mediated Communication on Language Complexity and Sentiment},
  author = {Kristen Sussman and Daniel Carter},
  year   = {2025},
  eprint = {2504.19556},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2504.19556v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2504.19556.svg)](https://codeofpaper.com/paper/2504.19556)

Discussion