Audio Editing with Non-Rigid Text Prompts

Francesco Paissan, Luca Della Libera, Zhepei Wang, Mirco Ravanelli, Paris Smaragdis +1 more
10/19/2023
cs.SDcs.LGeess.AS

No confident code implementation found for this paper.

Abstract

In this paper, we explore audio-editing with non-rigid text edits. We show that the proposed editing pipeline is able to create audio edits that remain faithful to the input audio. We explore text prompts that perform addition, style transfer, and in-painting. We quantitatively and qualitatively show that the edits are able to obtain results which outperform Audio-LDM, a recently released text-prompted audio generation model. Qualitative inspection of the results points out that the edits given by our approach remain more faithful to the input audio in terms of keeping the original onsets and offsets of the audio events.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

SAO-Instruct: Free-form Audio Editing using Natural Language Instructions

82% match2025

Prompt-guided Precise Audio Editing with Diffusion Models

82% match2024

Speech Editing -- a Summary

81% match2024

MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Models

81% match1 repo492024

In-Context Prompt Editing For Conditional Audio Generation

81% match2023

Instruct-MusicGen: Unlocking Text-to-Music Editing for Music Language Models via Instruction Tuning

80% match1 repo1092024

Cite this paper

@article{paissan2023audio,
  title  = {Audio Editing with Non-Rigid Text Prompts},
  author = {Francesco Paissan and Luca Della Libera and Zhepei Wang and Mirco Ravanelli and Paris Smaragdis and Cem Subakan},
  year   = {2023},
  eprint = {2310.12858},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2310.12858v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2310.12858.svg)](https://codeofpaper.com/paper/2310.12858)

Discussion