VuLASTE: Long Sequence Model with Abstract Syntax Tree Embedding for vulnerability Detection

Botong Zhu, Huobin Tan
2/5/2023
cs.SEcs.AI

No confident code implementation found for this paper.

Abstract

In this paper, we build a model named VuLASTE, which regards vulnerability detection as a special text classification task. To solve the vocabulary explosion problem, VuLASTE uses a byte level BPE algorithm from natural language processing. In VuLASTE, a new AST path embedding is added to represent source code nesting information. We also use a combination of global and dilated window attention from Longformer to extract long sequence semantic from source code. To solve the data imbalance problem, which is a common problem in vulnerability detection datasets, focal loss is used as loss function to make model focus on poorly classified cases during training. To test our model performance on real-world source code, we build a cross-language and multi-repository vulnerability dataset from Github Security Advisory Database. On this dataset, VuLASTE achieved top 50, top 100, top 200, top 500 hits of 29, 51, 86, 228, which are higher than state-of-art researches.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

VulDetectBench: Evaluating the Deep Capability of Vulnerability Detection with Large Language Models

89% match1 repo382024

LLMs in Software Security: A Survey of Vulnerability Detection Techniques and Insights

88% match2025

LProtector: An LLM-driven Vulnerability Detection System

88% match2024

Harnessing Large Language Models for Software Vulnerability Detection: A Comprehensive Benchmarking Study

88% match2024

White-Basilisk: A Hybrid Model for Code Vulnerability Detection

87% match2025

VulnLLMEval: A Framework for Evaluating Large Language Models in Software Vulnerability Detection and Patching

87% match2024

Cite this paper

@article{zhu2023vulaste,
  title  = {VuLASTE: Long Sequence Model with Abstract Syntax Tree Embedding for vulnerability Detection},
  author = {Botong Zhu and Huobin Tan},
  year   = {2023},
  eprint = {2302.02345},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2302.02345v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2302.02345.svg)](https://codeofpaper.com/paper/2302.02345)

Discussion