Contrastive Learning and Adversarial Disentanglement for Privacy-Aware Task-Oriented Semantic Communication

Omar Erak, Omar Alhussein, Wen Tong
10/30/2024
cs.LGcs.AIcs.CV

No official code found. Best implementation: OmarErak/CLAD (12 stars, MIT, last commit 2024-12-31).

Abstract

Task-oriented semantic communication systems have emerged as a promising approach to achieving efficient and intelligent data transmission in next-generation networks, where only information relevant to a specific task is communicated. This is particularly important in 6G-enabled Internet of Things (6G-IoT) scenarios, where bandwidth constraints, latency requirements, and data privacy are critical. However, existing methods struggle to fully disentangle task-relevant and task-irrelevant information, leading to privacy concerns and suboptimal performance. To address this, we propose an information-bottleneck inspired method, named CLAD (contrastive learning and adversarial disentanglement). CLAD utilizes contrastive learning to effectively capture task-relevant features while employing adversarial disentanglement to discard task-irrelevant information. Additionally, due to the absence of reliable and reproducible methods to quantify the minimality of encoded feature vectors, we introduce the Information Retention Index (IRI), a comparative metric used as a proxy for the mutual information between the encoded features and the input. The IRI reflects how minimal and informative the representation is, making it highly relevant for privacy-preserving and bandwidth-efficient 6G-IoT systems. Extensive experiments demonstrate that CLAD outperforms state-of-the-art baselines in terms of semantic extraction, task performance, privacy preservation, and IRI, making it a promising building block for responsible, efficient and trustworthy 6G-IoT services.

View on arXivView PDF

Code Implementations(1)

OmarErak/CLADCommunity100%
MIT

Contrastive Learning Adversarial Disentanglement for Task Oriented Communications

122Python, Jupyter NotebookOct 4, 20241 years agoMIT

Similar Papers

Cite this paper

@article{erak2024contrastive,
  title  = {Contrastive Learning and Adversarial Disentanglement for Privacy-Aware Task-Oriented Semantic Communication},
  author = {Omar Erak and Omar Alhussein and Wen Tong},
  year   = {2024},
  eprint = {2410.22784},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2410.22784v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2410.22784.svg)](https://codeofpaper.com/paper/2410.22784)

Discussion