RL-X: A Deep Reinforcement Learning Library (not only) for RoboCup
Official code: nico-bohlinger/RL-X (268 stars, MIT, last commit 2026-05-03).
Abstract
This paper presents the new Deep Reinforcement Learning (DRL) library RL-X and its application to the RoboCup Soccer Simulation 3D League and classic DRL benchmarks. RL-X provides a flexible and easy-to-extend codebase with self-contained single directory algorithms. Through the fast JAX-based implementations, RL-X can reach up to 4.5x speedups compared to well-known frameworks like Stable-Baselines3.