MentalChat16K: A Benchmark Dataset for Conversational Mental Health Assistance

Jia Xu, Tianyi Wei, Bojian Hou, Patryk Orzechowski, Shu Yang +5 more
3/13/2025
cs.LGcs.AIcs.CL

Official code: ChiaPatricia/MentalChat16K (8 stars, MIT, last commit 2025-03-31). 2 more implementations below.

Abstract

We introduce MentalChat16K, an English benchmark dataset combining a synthetic mental health counseling dataset and a dataset of anonymized transcripts from interventions between Behavioral Health Coaches and Caregivers of patients in palliative or hospice care. Covering a diverse range of conditions like depression, anxiety, and grief, this curated dataset is designed to facilitate the development and evaluation of large language models for conversational mental health assistance. By providing a high-quality resource tailored to this critical domain, MentalChat16K aims to advance research on empathetic, personalized AI solutions to improve access to mental health support services. The dataset prioritizes patient privacy, ethical considerations, and responsible data usage. MentalChat16K presents a valuable opportunity for the research community to innovate AI technologies that can positively impact mental well-being. The dataset is available at https://huggingface.co/datasets/ShenLab/MentalChat16K and the code and documentation are hosted on GitHub at https://github.com/ChiaPatricia/MentalChat16K.

View on arXivView PDF

Code Implementations(3)

ChiaPatricia/MentalChat16KOfficial100%
MIT

A benchmark dataset designed to support the development and evaluation of large language models (LLMs) for conversational mental health assistance

80Dec 13, 20241 years agoMIT
PennShenLab/MentalChat16KCommunity76%
MIT

A benchmark dataset designed to support the development and evaluation of large language models (LLMs) for conversational mental health assistance

234Jun 13, 20241 years agoMIT
llmllm-trainingmental-health
BalaAnbalagan/MentalChat16KCommunity64%

CMPE 255 Data Mining Assignment: Analysis of MentalChat16K - A Benchmark Dataset for Conversational Mental Health Assistance

00Python, Jupyter NotebookNov 25, 202510 months ago

Similar Papers

Mentalic Net: Development of RAG-based Conversational AI and Evaluation Framework for Mental Health Support

84% match2025

A Comprehensive Review of Datasets for Clinical Mental Health AI Systems

84% match2025

MindEval: Benchmarking Language Models on Multi-turn Mental Health Support

83% match2025

ConvCounsel: A Conversational Dataset for Student Counseling

82% match2024

Enhancing Mental Health Support through Human-AI Collaboration: Toward Secure and Empathetic AI-enabled chatbots

82% match2024

An Offline Mobile Conversational Agent for Mental Health Support: Learning from Emotional Dialogues and Psychological Texts with Student-Centered Evaluation

82% match2025

Cite this paper

@article{xu2025mentalchatk,
  title  = {MentalChat16K: A Benchmark Dataset for Conversational Mental Health Assistance},
  author = {Jia Xu and Tianyi Wei and Bojian Hou and Patryk Orzechowski and Shu Yang and Ruochen Jin and Rachael Paulbeck and Joost Wagenaar and George Demiris and Li Shen},
  year   = {2025},
  eprint = {2503.13509},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2503.13509v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2503.13509.svg)](https://codeofpaper.com/paper/2503.13509)

Discussion