BERT4MIMO: A Foundation Model using BERT Architecture for Massive MIMO Channel State Information Prediction

Ferhat Ozgur Catak, Murat Kuzlu, Umit Cali
1/3/2025
cs.ITcs.AIeess.SP

No official code found. Best implementation: ocatak/BERT4MIMO-AI4Wireless (19 stars, last commit 2025-09-20).

Abstract

Massive MIMO (Multiple-Input Multiple-Output) is an advanced wireless communication technology, using a large number of antennas to improve the overall performance of the communication system in terms of capacity, spectral, and energy efficiency. The performance of MIMO systems is highly dependent on the quality of channel state information (CSI). Predicting CSI is, therefore, essential for improving communication system performance, particularly in MIMO systems, since it represents key characteristics of a wireless channel, including propagation, fading, scattering, and path loss. This study proposes a foundation model inspired by BERT, called BERT4MIMO, which is specifically designed to process high-dimensional CSI data from massive MIMO systems. BERT4MIMO offers superior performance in reconstructing CSI under varying mobility scenarios and channel conditions through deep learning and attention mechanisms. The experimental results demonstrate the effectiveness of BERT4MIMO in a variety of wireless environments.

View on arXivView PDF

Code Implementations(1)

ocatak/BERT4MIMO-AI4WirelessCommunity100%

CSIBERT-AI4Wireless is a comprehensive repository dedicated to the implementation, evaluation, and analysis of the CSIBERT model, a novel transformer-based approach for enhancing wireless communication systems.

193MATLAB, PythonDec 1, 20241 years ago

Similar Papers

A MIMO Wireless Channel Foundation Model via CIR-CSI Consistency

84% match2025

A Deep Learning Framework for Wireless Radiation Field Reconstruction and Channel Prediction

84% match1 repo452026

The Future of Aerial Communications: A Survey of IRS-Enhanced UAV Communication Technologies

84% match2024

Deep Learning-based Techniques for Integrated Sensing and Communication Systems: State-of-the-Art, Challenges, and Opportunities

83% match2025

Spatial Channel State Information Prediction with Generative AI: Towards Holographic Communication and Digital Radio Twin

83% match2024

Deep Learning in Physical Layer: Review on Data Driven End-to-End Communication Systems and their Enabling Semantic Applications

83% match2024

Cite this paper

@article{catak2025bertmimo,
  title  = {BERT4MIMO: A Foundation Model using BERT Architecture for Massive MIMO Channel State Information Prediction},
  author = {Ferhat Ozgur Catak and Murat Kuzlu and Umit Cali},
  year   = {2025},
  eprint = {2501.01802},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2501.01802v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2501.01802.svg)](https://codeofpaper.com/paper/2501.01802)

Discussion