Array Camera Image Fusion using Physics-Aware Transformers

Qian Huang, Minghao Hu, David Jones Brady
7/5/2022
cs.CVeess.IV

No official code found. Best implementation: djbradyAtOpticalSciencesArizona/physicsAwareTransformer (5 stars, last commit 2023-03-28).

Abstract

We demonstrate a physics-aware transformer for feature-based data fusion from cameras with diverse resolution, color spaces, focal planes, focal lengths, and exposure. We also demonstrate a scalable solution for synthetic training data generation for the transformer using open-source computer graphics software. We demonstrate image synthesis on arrays with diverse spectral responses, instantaneous field of view and frame rate.

View on arXivView PDF

Code Implementations(1)

djbradyAtOpticalSciencesArizona/physicsAwareTransformerCommunity100%
52Python, Jupyter NotebookJun 30, 20223 years ago

Similar Papers

TripoSR: Fast 3D Object Reconstruction from a Single Image

84% match1 repo6.9k2024

Is Attention All That NeRF Needs?

81% match2022

ShapeGen: Towards High-Quality 3D Shape Synthesis

81% match2025

Co-Me: Confidence-Guided Token Merging for Visual Geometric Transformers

81% match1 repo1962025

Fine-Tuning Open Video Generators for Cinematic Scene Synthesis: A Small-Data Pipeline with LoRA and Wan2.1 I2V

81% match2025

TinyViT: Fast Pretraining Distillation for Small Vision Transformers

80% match2 repos1.8k2022

Cite this paper

@article{huang2022array,
  title  = {Array Camera Image Fusion using Physics-Aware Transformers},
  author = {Qian Huang and Minghao Hu and David Jones Brady},
  year   = {2022},
  eprint = {2207.02250},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2207.02250v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2207.02250.svg)](https://codeofpaper.com/paper/2207.02250)

Discussion