GraphNet: A Large-Scale Computational Graph Dataset for Tensor Compiler Research

Xinqi Li, Yiqun Liu, Shan Jiang, Enrong Zheng, Huaijin Zheng +4 more
10/28/2025
cs.LGcs.CL

Official code: PaddlePaddle/GraphNet (95 stars, MIT, last commit 2026-04-24).

Abstract

We introduce GraphNet, a dataset of 2.7K real-world deep learning computational graphs with rich metadata, spanning six major task categories across multiple deep learning frameworks. To evaluate tensor compiler performance on these samples, we propose the benchmark metric Speedup Score S(t), which jointly considers runtime speedup and execution correctness under tunable tolerance levels, offering a reliable measure of general optimization capability. Furthermore, we extend S(t) to the Error-aware Speedup Score ES(t), which incorporates error information and helps compiler developers identify key performance bottlenecks. In this report, we benchmark the default tensor compilers, CINN for PaddlePaddle and TorchInductor for PyTorch, on computer vision (CV) and natural language processing (NLP) samples to demonstrate the practicality of GraphNet. The full construction pipeline with graph extraction and compiler evaluation tools is available at https://github.com/PaddlePaddle/GraphNet .

View on arXivView PDF

Code Implementations(1)

MIT

A Large-Scale Computation Graph Database for Tensor Compiler Research

9550Shell, PythonJul 18, 20256 months agoMIT

Similar Papers

Cite this paper

@article{li2025graphnet,
  title  = {GraphNet: A Large-Scale Computational Graph Dataset for Tensor Compiler Research},
  author = {Xinqi Li and Yiqun Liu and Shan Jiang and Enrong Zheng and Huaijin Zheng and Wenhao Dai and Haodong Deng and Dianhai Yu and Yanjun Ma},
  year   = {2025},
  eprint = {2510.24035},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2510.24035v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2510.24035.svg)](https://codeofpaper.com/paper/2510.24035)

Discussion