AceParse: A Comprehensive Dataset with Diverse Structured Texts for Academic Literature Parsing

Huawei Ji, Cheng Deng, Bo Xue, Zhouyang Jin, Jiaxin Ding +4 more
9/16/2024
cs.CLcs.AI

Official code: JHW5981/AceParse (44 stars, Apache-2.0, last commit 2024-09-17).

Abstract

With the development of data-centric AI, the focus has shifted from model-driven approaches to improving data quality. Academic literature, as one of the crucial types, is predominantly stored in PDF formats and needs to be parsed into texts before further processing. However, parsing diverse structured texts in academic literature remains challenging due to the lack of datasets that cover various text structures. In this paper, we introduce AceParse, the first comprehensive dataset designed to support the parsing of a wide range of structured texts, including formulas, tables, lists, algorithms, and sentences with embedded mathematical expressions. Based on AceParse, we fine-tuned a multimodal model, named AceParser, which accurately parses various structured texts within academic literature. This model outperforms the previous state-of-the-art by 4.1% in terms of F1 score and by 5% in Jaccard Similarity, demonstrating the potential of multimodal models in academic literature parsing. Our dataset is available at https://github.com/JHW5981/AceParse.

View on arXivView PDF

Code Implementations(1)

JHW5981/AceParseOfficial100%
Apache-2.0

AceParse: A Comprehensive Dataset with Diverse Structured Texts for Academic Literature Parsing

442TeX, ShellAug 31, 20242 years agoApache-2.0

Similar Papers

Cite this paper

@article{ji2024aceparse,
  title  = {AceParse: A Comprehensive Dataset with Diverse Structured Texts for Academic Literature Parsing},
  author = {Huawei Ji and Cheng Deng and Bo Xue and Zhouyang Jin and Jiaxin Ding and Xiaoying Gan and Luoyi Fu and Xinbing Wang and Chenghu Zhou},
  year   = {2024},
  eprint = {2409.10016},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2409.10016v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2409.10016.svg)](https://codeofpaper.com/paper/2409.10016)

Discussion