Shoulders of Giants: A Look at the Degree and Utility of Openness in NLP Research

Surangika Ranathunga, Nisansa de Silva, Dilith Jayakody, Aloka Fernando
6/10/2024
cs.CL

No confident code implementation found for this paper.

Abstract

We analysed a sample of NLP research papers archived in ACL Anthology as an attempt to quantify the degree of openness and the benefit of such an open culture in the NLP community. We observe that papers published in different NLP venues show different patterns related to artefact reuse. We also note that more than 30% of the papers we analysed do not release their artefacts publicly, despite promising to do so. Further, we observe a wide language-wise disparity in publicly available NLP-related artefacts.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

NLP Meets the World: Toward Improving Conversations With the Public About Natural Language Processing Research

80% match2025

The Nature of NLP: Analyzing Contributions in NLP Papers

80% match1 repo32024

Internal and External Impacts of Natural Language Processing Papers

78% match2025

Building Better: Avoiding Pitfalls in Developing Language Resources when Data is Scarce

78% match2024

Social Good or Scientific Curiosity? Uncovering the Research Framing Behind NLP Artefacts

77% match2025

Transforming Scholarly Landscapes: Influence of Large Language Models on Academic Fields beyond Computer Science

77% match1 repo2024

Cite this paper

@article{ranathunga2024shoulders,
  title  = {Shoulders of Giants: A Look at the Degree and Utility of Openness in NLP Research},
  author = {Surangika Ranathunga and Nisansa de Silva and Dilith Jayakody and Aloka Fernando},
  year   = {2024},
  eprint = {2406.06021},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2406.06021v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2406.06021.svg)](https://codeofpaper.com/paper/2406.06021)

Discussion