Deep Transformer Network for Monocular Pose Estimation of Shipborne Unmanned Aerial Vehicle

Maneesha Wickramasuriya, Taeyoung Lee, Murray Snyder
6/13/2024
cs.CVcs.AIcs.RO

No official code found. Best implementation: fdcl-gwu/TNN-MO (3 stars, last commit 2024-06-15).

Abstract

This paper introduces a deep transformer network for estimating the relative 6D pose of a Unmanned Aerial Vehicle (UAV) with respect to a ship using monocular images. A synthetic dataset of ship images is created and annotated with 2D keypoints of multiple ship parts. A Transformer Neural Network model is trained to detect these keypoints and estimate the 6D pose of each part. The estimates are integrated using Bayesian fusion. The model is tested on synthetic data and in-situ flight experiments, demonstrating robustness and accuracy in various lighting conditions. The position estimation error is approximately 0.8\% and 1.0\% of the distance to the ship for the synthetic data and the flight experiments, respectively. The method has potential applications for ship-based autonomous UAV landing and navigation.

View on arXivView PDF

Code Implementations(1)

fdcl-gwu/TNN-MOCommunity100%
31Shell, PythonJun 10, 20242 years ago

Similar Papers

Bridging the Domain Gap for Flight-Ready Spaceborne Vision

86% match2024

Domain Generalization for In-Orbit 6D Pose Estimation

85% match2024

Real-Time Fusion of Visual and Chart Data for Enhanced Maritime Vision

84% match2025

Vision-in-the-loop Simulation for Deep Monocular Pose Estimation of UAV in Ocean Environment

84% match2025

A Computer Vision Approach to Estimate the Localized Sea State

82% match2024

Leveraging Neural Radiance Fields for Pose Estimation of an Unknown Space Object during Proximity Operations

82% match2024

Cite this paper

@article{wickramasuriya2024deep,
  title  = {Deep Transformer Network for Monocular Pose Estimation of Shipborne Unmanned Aerial Vehicle},
  author = {Maneesha Wickramasuriya and Taeyoung Lee and Murray Snyder},
  year   = {2024},
  eprint = {2406.09260},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2406.09260v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2406.09260.svg)](https://codeofpaper.com/paper/2406.09260)

Discussion