Open Source
Reference-Guided Turn-Taking Style Transfer for Full-Duplex Spoken Language Models
arXiv cs.SD0 views
arXiv:2610.20763v1 Announce Type: cross Abstract: Full-duplex spoken language models decide at every frame whether to take the floor, defining a conversational personality -- yet each set of weights encodes exactly one, which human speakers bracket rather than share. Existing controls mostly act from outside; none identifies the quantity that sets how much the model speaks. We identify it: a single late-layer residual-stream direction, the initiative vector, extracted from the model's own conversations without training or annotation. The same direction reads the decision, anticipating onsets up to 800 ms ahead, and shifts it: scaled during generation, it moves speech ratio from 6-12% to 42-61% (no steering: 21-30%), consistently across conversations, weights, and corpora. A short reference recording suffices to transfer a speaker's turn-taking style to the model, and the transfer is reference-specific: swapping in another speaker's reference worsens the match in 93-98% of cases, whereas the best uniform dose is indistinguishable from no steering. Turn-taking style is not frozen into the weights but a direction that can be read, shifted, and calibrated per person. Audio examples are available at https://elpsykongloo.github.io/initiative-vector/.
Source:https://arxiv.org/abs/2610.20763PreviousBackward Compatibility in Zero-Bit Neural Audio WatermarkingNextPEDBench: Can Speech Models Detect Phonetic Errors?
Related posts

My uninstaller refuses to delete anything it can't prove belongs to the app. Poke holes in my safety rules
0dev.to C#
让 AI 编程助手少返工:10 条命令规则合集(免费读)
0dev.to OpenSource
Discovering contemporaneous and lagged causal relations in autocorrelated nonlinear time series datasets
0arXiv stat.ML
I3L: Iterative Interactive Imitation Learning for Whole-Body Mobile Manipulation
0arXiv cs.RO
Sequential Planning via Anchored Robotic Keypoints
0arXiv cs.RO
WildOS: Open-Vocabulary Object Search in the Wild
0arXiv cs.RO