GPTEval: A Survey on Assessments of ChatGPT and GPT-4

Rui Mao, Guanyi Chen, Xulang Zhang, Frank Guerin, Erik Cambria
8/24/2023
cs.AIcs.CL

No confident code implementation found for this paper.

Abstract

The emergence of ChatGPT has generated much speculation in the press about its potential to disrupt social and economic systems. Its astonishing language ability has aroused strong curiosity among scholars about its performance in different domains. There have been many studies evaluating the ability of ChatGPT and GPT-4 in different tasks and disciplines. However, a comprehensive review summarizing the collective assessment findings is lacking. The objective of this survey is to thoroughly analyze prior assessments of ChatGPT and GPT-4, focusing on its language and reasoning abilities, scientific knowledge, and ethical considerations. Furthermore, an examination of the existing evaluation methods is conducted, offering several recommendations for future research in evaluating large language models.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Sparks of Artificial General Intelligence: Early experiments with GPT-4

87% match2023

Gpt-4: A Review on Advancements and Opportunities in Natural Language Processing

87% match2023

GPT-Fathom: Benchmarking Large Language Models to Decipher the Evolutionary Path towards GPT-4 and Beyond

86% match1 repo3432023

Performance of Large Language Models in a Computer Science Degree Program

86% match2023

Evaluating GPT-3.5 and GPT-4 on Grammatical Error Correction for Brazilian Portuguese

86% match2023

The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4

86% match2023

Cite this paper

@article{mao2023gpteval,
  title  = {GPTEval: A Survey on Assessments of ChatGPT and GPT-4},
  author = {Rui Mao and Guanyi Chen and Xulang Zhang and Frank Guerin and Erik Cambria},
  year   = {2023},
  eprint = {2308.12488},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2308.12488v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2308.12488.svg)](https://codeofpaper.com/paper/2308.12488)

Discussion