Is Peer-Reviewing Worth the Effort?

Kenneth Church, Raman Chandrasekar, John E. Ortega, Ibrahim Said Ahmad
12/18/2024
cs.CLcs.AI

No official code found. Best implementation: kwchurch/is-peer-reviewing-worth-the-effort (1 star, MIT, last commit 2024-12-02).

Abstract

How effective is peer-reviewing in identifying important papers? We treat this question as a forecasting task. Can we predict which papers will be highly cited in the future based on venue and "early returns" (citations soon after publication)? We show early returns are more predictive than venue. Finally, we end with constructive suggestions to address scaling challenges: (a) too many submissions and (b) too few qualified reviewers.

View on arXivView PDF

Code Implementations(1)

kwchurch/is-peer-reviewing-worth-the-effortCommunity100%
MIT
10Dec 2, 20241 years agoMIT

Similar Papers

Automatic Evaluation Metrics for Artificially Generated Scientific Research

82% match1 repo2025

Is Peer Review Really in Decline? Analyzing Review Quality across Venues and Time

82% match2026

PeerArg: Argumentative Peer Review with LLMs

81% match2024

ReviewerToo: Should AI Join The Program Committee? A Look At The Future of Peer Review

80% match2025

Are We There Yet? Revealing the Risks of Utilizing Large Language Models in Scholarly Peer Review

79% match2024

Unveiling the Sentinels: Assessing AI Performance in Cybersecurity Peer Review

79% match2023

Cite this paper

@article{church2024peerreviewing,
  title  = {Is Peer-Reviewing Worth the Effort?},
  author = {Kenneth Church and Raman Chandrasekar and John E. Ortega and Ibrahim Said Ahmad},
  year   = {2024},
  eprint = {2412.14351},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2412.14351v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2412.14351.svg)](https://codeofpaper.com/paper/2412.14351)

Discussion