GiPH: Generalizable Placement Learning for Adaptive Heterogeneous Computing

Yi Hu, Chaoran Zhang, Edward Andert, Harshul Singh, Aviral Shrivastava +4 more
5/23/2023
cs.LGeess.SY

No official code found. Best implementation: uidmice/placement-rl (1 star, MIT, last commit 2024-06-13).

Abstract

Careful placement of a computational application within a target device cluster is critical for achieving low application completion time. The problem is challenging due to its NP-hardness and combinatorial nature. In recent years, learning-based approaches have been proposed to learn a placement policy that can be applied to unseen applications, motivated by the problem of placing a neural network across cloud servers. These approaches, however, generally assume the device cluster is fixed, which is not the case in mobile or edge computing settings, where heterogeneous devices move in and out of range for a particular application. We propose a new learning approach called GiPH, which learns policies that generalize to dynamic device clusters via 1) a novel graph representation gpNet that efficiently encodes the information needed for choosing a good placement, and 2) a scalable graph neural network (GNN) that learns a summary of the gpNet information. GiPH turns the placement problem into that of finding a sequence of placement improvements, learning a policy for selecting this sequence that scales to problems of arbitrary size. We evaluate GiPH with a wide range of task graphs and device clusters and show that our learned policy rapidly find good placements for new problem instances. GiPH finds placements with up to 30.5% lower completion times, searching up to 3X faster than other search-based placement policies.

View on arXivView PDF

Code Implementations(1)

MIT
11Python, Jupyter NotebookOct 6, 20212 years agoMIT

Similar Papers

Cite this paper

@article{hu2023giph,
  title  = {GiPH: Generalizable Placement Learning for Adaptive Heterogeneous Computing},
  author = {Yi Hu and Chaoran Zhang and Edward Andert and Harshul Singh and Aviral Shrivastava and James Laudon and Yanqi Zhou and Bob Iannucci and Carlee Joe-Wong},
  year   = {2023},
  eprint = {2305.14562},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2305.14562v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2305.14562.svg)](https://codeofpaper.com/paper/2305.14562)

Discussion