Not All Jokes Land: Evaluating Large Language Models Understanding of Workplace Humor

Mohammadamin Shafiei, Hamidreza Saffari
6/2/2025
cs.CLcs.CY

No official code found. Best implementation: Mamin78/professional_humor_dataset (0 stars, MIT, last commit 2024-11-14).

Abstract

With the recent advances in Artificial Intelligence (AI) and Large Language Models (LLMs), the automation of daily tasks, like automatic writing, is getting more and more attention. Hence, efforts have focused on aligning LLMs with human values, yet humor, particularly professional industrial humor used in workplaces, has been largely neglected. To address this, we develop a dataset of professional humor statements along with features that determine the appropriateness of each statement. Our evaluation of five LLMs shows that LLMs often struggle to judge the appropriateness of humor accurately.

View on arXivView PDF

Code Implementations(1)

Mamin78/professional_humor_datasetCommunity71%
MIT

The repository for the "Not All Jokes Land: Evaluating Large Language Models’ Understanding of Workplace Humor" paper.

00Nov 11, 20241 years agoMIT

Similar Papers

From Punchlines to Predictions: A Metric to Assess LLM Performance in Identifying Humor in Stand-Up Comedy

87% match2025

Comparing Apples to Oranges: A Dataset & Analysis of LLM Humour Understanding from Traditional Puns to Topical Jokes

86% match2025

Assessing the Capabilities of LLMs in Humor:A Multi-dimensional Analysis of Oogiri Generation and Evaluation

86% match2025

Getting Serious about Humor: Crafting Humor Datasets with Unfunny Large Language Models

85% match1 repo112024

Optimizing Humor Generation in Large Language Models: Temperature Configurations and Architectural Trade-offs

84% match2025

Engagement Undermines Safety: How Stereotypes and Toxicity Shape Humor in Language Models

84% match2025

Cite this paper

@article{shafiei2025jokes,
  title  = {Not All Jokes Land: Evaluating Large Language Models Understanding of Workplace Humor},
  author = {Mohammadamin Shafiei and Hamidreza Saffari},
  year   = {2025},
  eprint = {2506.01819},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2506.01819v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2506.01819.svg)](https://codeofpaper.com/paper/2506.01819)

Discussion