Exploiting Alpha Transparency In Language And Vision-Based AI Systems

David Noever, Forrest McKee
2/15/2024
cs.CVcs.LG

No confident code implementation found for this paper. 4 possible matches can be shown below.

Abstract

This investigation reveals a novel exploit derived from PNG image file formats, specifically their alpha transparency layer, and its potential to fool multiple AI vision systems. Our method uses this alpha layer as a clandestine channel invisible to human observers but fully actionable by AI image processors. The scope tested for the vulnerability spans representative vision systems from Apple, Microsoft, Google, Salesforce, Nvidia, and Facebook, highlighting the attack's potential breadth. This vulnerability challenges the security protocols of existing and fielded vision systems, from medical imaging to autonomous driving technologies. Our experiments demonstrate that the affected systems, which rely on convolutional neural networks or the latest multimodal language models, cannot quickly mitigate these vulnerabilities through simple patches or updates. Instead, they require retraining and architectural changes, indicating a persistent hole in multimodal technologies without some future adversarial hardening against such vision-language exploits.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 4 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{noever2024exploiting,
  title  = {Exploiting Alpha Transparency In Language And Vision-Based AI Systems},
  author = {David Noever and Forrest McKee},
  year   = {2024},
  eprint = {2402.09671},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2402.09671v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2402.09671.svg)](https://codeofpaper.com/paper/2402.09671)

Discussion