Feasibility and Transferability of Transfer Learning: A Mathematical Framework

Haoyang Cao, Haotian Gu, Xin Guo, Mathieu Rosenbaum
1/27/2023
cs.LGstat.ML

No confident code implementation found for this paper. 2 possible matches can be shown below.

Abstract

Transfer learning is an emerging and popular paradigm for utilizing existing knowledge from previous learning tasks to improve the performance of new ones. Despite its numerous empirical successes, theoretical analysis for transfer learning is limited. In this paper we build for the first time, to the best of our knowledge, a mathematical framework for the general procedure of transfer learning. Our unique reformulation of transfer learning as an optimization problem allows for the first time, analysis of its feasibility. Additionally, we propose a novel concept of transfer risk to evaluate transferability of transfer learning. Our numerical studies using the Office-31 dataset demonstrate the potential and benefits of incorporating transfer risk in the evaluation of transfer learning performance.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 2 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{cao2023feasibility,
  title  = {Feasibility and Transferability of Transfer Learning: A Mathematical Framework},
  author = {Haoyang Cao and Haotian Gu and Xin Guo and Mathieu Rosenbaum},
  year   = {2023},
  eprint = {2301.11542},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2301.11542v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2301.11542.svg)](https://codeofpaper.com/paper/2301.11542)

Discussion