Autonomous Planning In-space Assembly Reinforcement-learning free-flYer (APIARY) International Space Station Astrobee Testing

Samantha Chapin, Kenneth Stewart, Roxana Leontie, Carl Glen Henshaw
12/3/2025
cs.ROcs.LGeess.SY

No confident code implementation found for this paper.

Abstract

The US Naval Research Laboratory's (NRL's) Autonomous Planning In-space Assembly Reinforcement-learning free-flYer (APIARY) experiment pioneers the use of reinforcement learning (RL) for control of free-flying robots in the zero-gravity (zero-G) environment of space. On Tuesday, May 27th 2025 the APIARY team conducted the first ever, to our knowledge, RL control of a free-flyer in space using the NASA Astrobee robot on-board the International Space Station (ISS). A robust 6-degrees of freedom (DOF) control policy was trained using an actor-critic Proximal Policy Optimization (PPO) network within the NVIDIA Isaac Lab simulation environment, randomizing over goal poses and mass distributions to enhance robustness. This paper details the simulation testing, ground testing, and flight validation of this experiment. This on-orbit demonstration validates the transformative potential of RL for improving robotic autonomy, enabling rapid development and deployment (in minutes to hours) of tailored behaviors for space exploration, logistics, and real-time mission needs.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Crossing the Sim2Real Gap Between Simulation and Ground Testing to Space Deployment of Autonomous Free-flyer Control

92% match2025

Space Robotics Bench: Robot Learning Beyond Earth

86% match1 repo1942025

Leveraging Procedural Generation for Learning Autonomous Peg-in-Hole Assembly in Space

85% match2 repos182024

Deep Learning Warm Starts for Trajectory Optimization on the International Space Station

83% match2025

Investigating the Impact of Choice on Deep Reinforcement Learning for Space Controls

82% match2024

ASTREA: Introducing Agentic Intelligence for Orbital Thermal Autonomy

82% match2025

Cite this paper

@article{chapin2025autonomous,
  title  = {Autonomous Planning In-space Assembly Reinforcement-learning free-flYer (APIARY) International Space Station Astrobee Testing},
  author = {Samantha Chapin and Kenneth Stewart and Roxana Leontie and Carl Glen Henshaw},
  year   = {2025},
  eprint = {2512.03729},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2512.03729v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2512.03729.svg)](https://codeofpaper.com/paper/2512.03729)

Discussion