Can ChatGPT Read Who You Are?

Erik Derner, Dalibor Kučera, Nuria Oliver, Jan Zahálka
12/26/2023
cs.CYcs.CLcs.HC

No confident code implementation found for this paper. 4 possible matches can be shown below.

Abstract

The interplay between artificial intelligence (AI) and psychology, particularly in personality assessment, represents an important emerging area of research. Accurate personality trait estimation is crucial not only for enhancing personalization in human-computer interaction but also for a wide variety of applications ranging from mental health to education. This paper analyzes the capability of a generic chatbot, ChatGPT, to effectively infer personality traits from short texts. We report the results of a comprehensive user study featuring texts written in Czech by a representative population sample of 155 participants. Their self-assessments based on the Big Five Inventory (BFI) questionnaire serve as the ground truth. We compare the personality trait estimations made by ChatGPT against those by human raters and report ChatGPT's competitive performance in inferring personality traits from text. We also uncover a 'positivity bias' in ChatGPT's assessments across all personality dimensions and explore the impact of prompt composition on accuracy. This work contributes to the understanding of AI capabilities in psychological assessment, highlighting both the potential and limitations of using large language models for personality inference. Our research underscores the importance of responsible AI development, considering ethical implications such as privacy, consent, autonomy, and bias in AI applications.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 4 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{derner2023chatgpt,
  title  = {Can ChatGPT Read Who You Are?},
  author = {Erik Derner and Dalibor Kučera and Nuria Oliver and Jan Zahálka},
  year   = {2023},
  eprint = {2312.16070},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2312.16070v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2312.16070.svg)](https://codeofpaper.com/paper/2312.16070)

Discussion