The Rate-Distortion-Perception-Classification Tradeoff: Joint Source Coding and Modulation via Inverse-Domain GANs

Junli Fang, João F. C. Mota, Baoshan Lu, Weicheng Zhang, Xuemin Hong
12/22/2023
cs.LGcs.AIcs.CV

No official code found. Best implementation: JunliFang/ID-GAN-RDPC (2 stars, last commit 2025-10-15).

Abstract

The joint source-channel coding (JSCC) framework leverages deep learning to learn from data the best codes for source and channel coding. When the output signal, rather than being binary, is directly mapped onto the IQ domain (complex-valued), we call the resulting framework joint source coding and modulation (JSCM). We consider a JSCM scenario and show the existence of a strict tradeoff between channel rate, distortion, perception, and classification accuracy, a tradeoff that we name RDPC. We then propose two image compression methods to navigate that tradeoff: the RDPCO algorithm which, under simple assumptions, directly solves the optimization problem characterizing the tradeoff, and an algorithm based on an inverse-domain generative adversarial network (ID-GAN), which is more general and achieves extreme compression. Simulation results corroborate the theoretical findings, showing that both algorithms exhibit the RDPC tradeoff. They also demonstrate that the proposed ID-GAN algorithm effectively balances image distortion, perception, and classification accuracy, and significantly outperforms traditional separation-based methods and recent deep JSCM architectures in terms of one or more of these metrics.

View on arXivView PDF

Code Implementations(1)

A python implementation of ID-GAN in "The Rate-Distortion-Perception-Classification Tradeoff: Joint Source Coding and Modulation via Inverse-Domain GANs".

20PythonJan 5, 20251 years ago

Cite this paper

@article{fang2023ratedistortionperceptionclassification,
  title  = {The Rate-Distortion-Perception-Classification Tradeoff: Joint Source Coding and Modulation via Inverse-Domain GANs},
  author = {Junli Fang and João F. C. Mota and Baoshan Lu and Weicheng Zhang and Xuemin Hong},
  year   = {2023},
  eprint = {2312.14792},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2312.14792v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2312.14792.svg)](https://codeofpaper.com/paper/2312.14792)

Discussion