AI & ML
FoleyForge: Free-form, Controllable, Rectified-flow Editing of Sound Effects
arXiv cs.SD0 views
arXiv:2611.08695v1 Announce Type: new Abstract: We present FoleyForge, a generative model for instruction-based editing of sound effects. Given an input clip and a free-form instruction describing the desired change, it applies the edit while preserving the input's identity. A single model handles semantic, stylistic, and DSP-like changes. We introduce a data pipeline that guides an audio language model to author both DSP-based acoustic edits and similarity-preserving semantic edits, thus addressing the lack of publicly available audio editing data. Such data is then used to fine-tune a rectified-flow audio generation model, which we extend to expose attribute controls for loudness change, edit strength, and an input-derived contour envelope, each tunable via classifier-free guidance, yielding a more expressive editing model. FoleyForge achieves state-of-the-art instruction adherence at competitive audio quality and source faithfulness.
Source:https://arxiv.org/abs/2611.08695PreviousInstance-Optimal Estimation with Multiple LLM Judges on a BudgetNextAircraftWitness: How Often Aircraft Can Locate Recordings
Related posts
An Empirical Analysis of Static Analysis Methods for Detection and Mitigation of Code Library Hallucinations
0arXiv cs.SE
TATG: Tracking-Aware Testing Objective for LLM-based Test Generation
0arXiv cs.SE
MCP Server Architecture Patterns for LLM-Integrated Applications
0arXiv cs.SE
Introducing Cluster Efficiency to LLM Serving: Pooling Economical Accelerators over Fast Interconnects
0arXiv cs.DC
Evidence-Linked Radiology Reporting: A Human-Supervised Reference Architecture for Structured Imaging Intelligence
0arXiv cs.HC
Intentmaking and Sensemaking: Human Interaction with AI-Guided Mathematical Discovery
0arXiv cs.HC