S2ORC: The Semantic Scholar Open Research Corpus

Kyle Lo, Lucy Lu Wang, Mark Neumann, Rodney Kinney, Dan S. Weld
11/7/2019
cs.CLcs.DL

Official code: allenai/s2orc (1,090 stars, last commit 2024-04-26).

Abstract

We introduce S2ORC, a large corpus of 81.1M English-language academic papers spanning many academic disciplines. The corpus consists of rich metadata, paper abstracts, resolved bibliographic references, as well as structured full text for 8.1M open access papers. Full text is annotated with automatically-detected inline mentions of citations, figures, and tables, each linked to their corresponding paper objects. In S2ORC, we aggregate papers from hundreds of academic publishers and digital archives into a unified source, and create the largest publicly-available collection of machine-readable academic text to date. We hope this resource will facilitate research and development of tools and tasks for text mining over academic text.

View on arXivView PDF

Code Implementations(1)

allenai/s2orcOfficial100%

S2ORC: The Semantic Scholar Open Research Corpus: https://www.aclweb.org/anthology/2020.acl-main.447/

1,09081PythonNov 4, 20192 years ago

Similar Papers

EpiLens: Lightweight RAG for Epidemiological Knowledge Acquisition

82% match2026

unarXive 2022: All arXiv Publications Pre-Processed for NLP, Including Structured Full-Text and Citation Network

81% match1 repo3042023

All Data on the Table: Novel Dataset and Benchmark for Cross-Modality Scientific Information Extraction

81% match2023

Trends in Explainable AI (XAI) Literature

81% match1 repo212023

CHEAT: A Large-scale Dataset for Detecting ChatGPT-writtEn AbsTracts

81% match1 repo222023

Carolina: a General Corpus of Contemporary Brazilian Portuguese with Provenance, Typology and Versioning Information

81% match2023

Cite this paper

@article{lo2019sorc,
  title  = {S2ORC: The Semantic Scholar Open Research Corpus},
  author = {Kyle Lo and Lucy Lu Wang and Mark Neumann and Rodney Kinney and Dan S. Weld},
  year   = {2019},
  eprint = {1911.02782},
  archivePrefix = {arXiv},
  url    = {https://arxiv.org/abs/1911.02782}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/1911.02782.svg)](https://codeofpaper.com/paper/1911.02782)

Discussion