Optimizing Deep Reinforcement Learning for Adaptive Robotic Arm Control

Jonaid Shianifar, Michael Schukat, Karl Mason
6/12/2024
cs.ROcs.AI

No confident code implementation found for this paper. 5 possible matches can be shown below.

Abstract

In this paper, we explore the optimization of hyperparameters for the Soft Actor-Critic (SAC) and Proximal Policy Optimization (PPO) algorithms using the Tree-structured Parzen Estimator (TPE) in the context of robotic arm control with seven Degrees of Freedom (DOF). Our results demonstrate a significant enhancement in algorithm performance, TPE improves the success rate of SAC by 10.48 percentage points and PPO by 34.28 percentage points, where models trained for 50K episodes. Furthermore, TPE enables PPO to converge to a reward within 95% of the maximum reward 76% faster than without TPE, which translates to about 40K fewer episodes of training required for optimal performance. Also, this improvement for SAC is 80% faster than without TPE. This study underscores the impact of advanced hyperparameter optimization on the efficiency and success of deep reinforcement learning algorithms in complex robotic tasks.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 5 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Hyperparameters in Reinforcement Learning and How To Tune Them

85% match1 repo872026

ULTHO: Ultra-Lightweight yet Efficient Hyperparameter Optimization in Deep Reinforcement Learning

85% match2025

Combining Automated Optimisation of Hyperparameters and Reward Shape

85% match1 repo72024

A Method for Evaluating Hyperparameter Sensitivity in Reinforcement Learning

82% match1 repo22026

Optimizing TD3 for 7-DOF Robotic Arm Grasping: Overcoming Suboptimality with Exploration-Enhanced Contrastive Learning

82% match2024

ARLBench: Flexible and Efficient Benchmarking for Hyperparameter Optimization in Reinforcement Learning

82% match1 repo342024

Cite this paper

@article{shianifar2024optimizing,
  title  = {Optimizing Deep Reinforcement Learning for Adaptive Robotic Arm Control},
  author = {Jonaid Shianifar and Michael Schukat and Karl Mason},
  year   = {2024},
  eprint = {2407.02503},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2407.02503v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2407.02503.svg)](https://codeofpaper.com/paper/2407.02503)

Discussion