First Three Years of the International Verification of Neural Networks Competition (VNN-COMP)

Christopher Brix, Mark Niklas Müller, Stanley Bak, Taylor T. Johnson, Changliu Liu
1/14/2023
cs.LGcs.AIcs.SE

No confident code implementation found for this paper.

Abstract

This paper presents a summary and meta-analysis of the first three iterations of the annual International Verification of Neural Networks Competition (VNN-COMP) held in 2020, 2021, and 2022. In the VNN-COMP, participants submit software tools that analyze whether given neural networks satisfy specifications describing their input-output behavior. These neural networks and specifications cover a variety of problem classes and tasks, corresponding to safety and robustness properties in image classification, neural control, reinforcement learning, and autonomous systems. We summarize the key processes, rules, and results, present trends observed over the last three years, and provide an outlook into possible future developments.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

The Fifth International Verification of Neural Networks Competition (VNN-COMP 2024): Summary and Results

82% match2024

The NeurIPS 2022 Neural MMO Challenge: A Massively Multiagent Competition with Specialization and Trade

80% match2026

Formal Verification of Deep Neural Networks for Object Detection

79% match1 repo22024

The SaTML '24 CNN Interpretability Competition: New Innovations for Concept-Level Interpretability

78% match1 repo92024

Results of the NeurIPS 2023 Neural MMO Competition on Multi-task Reinforcement Learning

78% match2025

A Formally Verified Robustness Certifier for Neural Networks (Extended Version)

78% match2025

Cite this paper

@article{brix2023first,
  title  = {First Three Years of the International Verification of Neural Networks Competition (VNN-COMP)},
  author = {Christopher Brix and Mark Niklas Müller and Stanley Bak and Taylor T. Johnson and Changliu Liu},
  year   = {2023},
  eprint = {2301.05815},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2301.05815v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2301.05815.svg)](https://codeofpaper.com/paper/2301.05815)

Discussion