Towards Integrated Fine-tuning and Inference when Generative AI meets Edge Intelligence

Ning Chen, Zhipeng Cheng, Xuwei Fan, Xiaoyu Xia, Lianfen Huang
1/5/2024
cs.DCcs.LG

No confident code implementation found for this paper. 3 possible matches can be shown below.

Abstract

The high-performance generative artificial intelligence (GAI) represents the latest evolution of computational intelligence, while the blessing of future 6G networks also makes edge intelligence (EI) full of development potential. The inevitable encounter between GAI and EI can unleash new opportunities, where GAI's pre-training based on massive computing resources and large-scale unlabeled corpora can provide strong foundational knowledge for EI, while EI can harness fragmented computing resources to aggregate personalized knowledge for GAI. However, the natural contradictory features pose significant challenges to direct knowledge sharing. To address this, in this paper, we propose the GAI-oriented synthetical network (GaisNet), a collaborative cloud-edge-end intelligence framework that buffers contradiction leveraging data-free knowledge relay, where the bidirectional knowledge flow enables GAI's virtuous-cycle model fine-tuning and task inference, achieving mutualism between GAI and EI with seamless fusion and collaborative evolution. Experimental results demonstrate the effectiveness of the proposed mechanisms. Finally, we discuss the future challenges and directions in the interplay between GAI and EI.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 3 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{chen2024towards,
  title  = {Towards Integrated Fine-tuning and Inference when Generative AI meets Edge Intelligence},
  author = {Ning Chen and Zhipeng Cheng and Xuwei Fan and Xiaoyu Xia and Lianfen Huang},
  year   = {2024},
  eprint = {2401.02668},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2401.02668v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2401.02668.svg)](https://codeofpaper.com/paper/2401.02668)

Discussion