Decentralized Learning over Wireless Networks: The Effect of Broadcast with Random Access

Zheng Chen, Martin Dahl, Erik G. Larsson
5/12/2023
cs.NIcs.LGeess.SY

No confident code implementation found for this paper. 2 possible matches can be shown below.

Abstract

In this work, we focus on the communication aspect of decentralized learning, which involves multiple agents training a shared machine learning model using decentralized stochastic gradient descent (D-SGD) over distributed data. In particular, we investigate the impact of broadcast transmission and probabilistic random access policy on the convergence performance of D-SGD, considering the broadcast nature of wireless channels and the link dynamics in the communication topology. Our results demonstrate that optimizing the access probability to maximize the expected number of successful links is a highly effective strategy for accelerating the system convergence.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 2 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Decentralized Learning over Wireless Networks with Broadcast-Based Subgraph Sampling

92% match2023

Faster Convergence with Less Communication: Broadcast-Based Subgraph Sampling for Decentralized Learning over Wireless Networks

89% match2024

DRACO: Decentralized Asynchronous Federated Learning over Row-Stochastic Wireless Networks

85% match2024

Small-Scale-Fading-Aware Resource Allocation in Wireless Federated Learning

83% match2025

Mobility-Assisted Decentralized Federated Learning: Convergence Analysis and A Data-Driven Approach

83% match2025

Consensus-based Decentralized Multi-agent Reinforcement Learning for Random Access Network Optimization

83% match2025

Cite this paper

@article{chen2023decentralized,
  title  = {Decentralized Learning over Wireless Networks: The Effect of Broadcast with Random Access},
  author = {Zheng Chen and Martin Dahl and Erik G. Larsson},
  year   = {2023},
  eprint = {2305.07368},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2305.07368v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2305.07368.svg)](https://codeofpaper.com/paper/2305.07368)

Discussion