DreamColour: Controllable Video Colour Editing without Training

Chaitat Utintu, Pinaki Nath Chowdhury, Aneeshan Sain, Subhadeep Koley, Ayan Kumar Bhunia +1 more
12/6/2024
cs.CV

No official code found. Best implementation: CHAITron/DreamColour (0 stars, MIT, last commit 2024-12-24).

Abstract

Video colour editing is a crucial task for content creation, yet existing solutions either require painstaking frame-by-frame manipulation or produce unrealistic results with temporal artefacts. We present a practical, training-free framework that makes precise video colour editing accessible through an intuitive interface while maintaining professional-quality output. Our key insight is that by decoupling spatial and temporal aspects of colour editing, we can better align with users' natural workflow -- allowing them to focus on precise colour selection in key frames before automatically propagating changes across time. We achieve this through a novel technical framework that combines: (i) a simple point-and-click interface merging grid-based colour selection with automatic instance segmentation for precise spatial control, (ii) bidirectional colour propagation that leverages inherent video motion patterns, and (iii) motion-aware blending that ensures smooth transitions even with complex object movements. Through extensive evaluation on diverse scenarios, we demonstrate that our approach matches or exceeds state-of-the-art methods while eliminating the need for training or specialized hardware, making professional-quality video colour editing accessible to everyone.

View on arXivView PDF

Code Implementations(1)

MIT

Official implementation of "DreamColour: Controllable Video Colour Editing without Training"

00Dec 24, 20241 years agoMIT

Similar Papers

Cite this paper

@article{utintu2024dreamcolour,
  title  = {DreamColour: Controllable Video Colour Editing without Training},
  author = {Chaitat Utintu and Pinaki Nath Chowdhury and Aneeshan Sain and Subhadeep Koley and Ayan Kumar Bhunia and Yi-Zhe Song},
  year   = {2024},
  eprint = {2412.05180},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2412.05180v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2412.05180.svg)](https://codeofpaper.com/paper/2412.05180)

Discussion