A Framework for Automated Cellular Network Tuning with Reinforcement Learning

Faris B. Mismar, Jinseok Choi, Brian L. Evans
8/13/2018
cs.NIcs.LGstat.ML

Official code: farismismar/Q-Learning-Power-Control (51 stars, last commit 2022-01-24). 1 more implementation below.

Abstract

Tuning cellular network performance against always occurring wireless impairments can dramatically improve reliability to end users. In this paper, we formulate cellular network performance tuning as a reinforcement learning (RL) problem and provide a solution to improve the performance for indoor and outdoor environments. By leveraging the ability of Q-learning to estimate future performance improvement rewards, we propose two algorithms: (1) closed loop power control (PC) for downlink voice over LTE (VoLTE) and (2) self-organizing network (SON) fault management. The VoLTE PC algorithm uses RL to adjust the indoor base station transmit power so that the signal to interference plus noise ratio (SINR) of a user equipment (UE) meets the target SINR. It does so without the UE having to send power control requests. The SON fault management algorithm uses RL to improve the performance of an outdoor base station cluster by resolving faults in the network through configuration management. Both algorithms exploit measurements from the connected users, wireless impairments, and relevant configuration parameters to solve a non-convex performance optimization problem using RL. Simulation results show that our proposed RL based algorithms outperform the industry standards today in realistic cellular communication environments.

View on arXivView PDF

Code Implementations(2)

farismismar/Q-Learning-Power-ControlOfficial100%

Code for the following publication: F. B. Mismar, J. Choi, and B. L. Evans, "A Framework for Automated Cellular Network Tuning with Reinforcement Learning", IEEE Transactions on Communications, vol. 67, no. 10, Oct. 2019, pp. 7152-7167, DOI 10.1109/TCOMM.2019.2926715.

5128Shell, PythonJun 5, 20174 years ago
farismismar/Deep-Q-Learning-SON-Perf-ImprovementOfficial100%

Code for the following publication: F. B. Mismar, J. Choi, and B. L. Evans, "A Framework for Automated Cellular Network Tuning with Reinforcement Learning", IEEE Transactions on Communications, vol. 67, no. 10, Oct. 2019, pp. 7152-7167, DOI 10.1109/TCOMM.2019.2926715.

2611MATLAB, PythonJul 19, 20187 years ago

Similar Papers

Near-Real-Time Resource Slicing for QoS Optimization in 5G O-RAN using Deep Reinforcement Learning

85% match1 repo72025

Generative AI for the Optimization of Next-Generation Wireless Networks: Basics, State-of-the-Art, and Open Challenges

84% match2024

Distributed Learning Meets 6G: A Communication and Computing Perspective

84% match2023

WiSDoM: Wireless Sparse Decision Transformer with Mixture-of-Experts for Multi-Task Mobile Network Optimization

83% match2026

DRL Optimization Trajectory Generation via Wireless Network Intent-Guided Diffusion Models for Optimizing Resource Allocation

83% match2024

Offline Reinforcement Learning for Mobility Robustness Optimization

83% match2025

Cite this paper

@article{mismar2018framework,
  title  = {A Framework for Automated Cellular Network Tuning with Reinforcement Learning},
  author = {Faris B. Mismar and Jinseok Choi and Brian L. Evans},
  year   = {2018},
  eprint = {1808.05140},
  archivePrefix = {arXiv},
  url    = {https://arxiv.org/abs/1808.05140}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/1808.05140.svg)](https://codeofpaper.com/paper/1808.05140)

Discussion