AI & ML
Marimba: A System One Model for Speech
arXiv cs.SD0 views
arXiv:2611.18330v1 Announce Type: cross Abstract: Speech applications require decisions about term presence, turn completion, and language within an audio window. We present Marimba, an interface for typed speech decisions built on frozen Qwen3-ASR 0.6B features. Lexical questions use zero-shot scoring of ASR transcripts; non-lexical questions use a question-conditioned head and a separate layer-18 turn-end readout. Language identification uses the ASR model's own language scores. On private conversational test sets, decoder AUROC is 0.80-0.92; on public read speech it is 0.92-0.97. Speech Commands four-way accuracy is 0.93; binary lexical ECE is at most 0.08. Personal-information detection, which passes the greedy transcript to a private, curated PII pipeline, reaches item-level F1 0.904 on synthetic Brazilian Portuguese speech (1.000 on reference transcripts). Layer-12 speaker readouts detect speaker change with AUROC 0.966-0.980 on AMI and VoxConverse, above an ECAPA baseline, and count speakers (0, 1, 2, or 3+) more accurately than pyannote 3.1. The turn-end readout reaches AUROC 0.930 versus Smart Turn v3.2 at 0.982 on Smart Turn's own test set. On a subset of ICSI meetings labeled by next speaker, AUROC is 0.716 versus 0.712; the paired confidence interval includes zero.
Source:https://arxiv.org/abs/2611.18330Related posts
How to Trim Audio for an Online Course Lesson — Free, in Your Browser
0dev.to WebDev
Chemical Anchor Fasteners: A Practical Guide to Stainless Steel Chemical Anchor Studs
0dev.to WebDev
Automating Notion Desktop App Installation on Arch Linux
0dev.to Linux
existence-trace: a journal your AI reads, and has to prove it used
0dev.to Python
A 30-question regression suite for your customer-service chatbot (with a tiny Python runner)
0dev.to Python
The boring-infrastructure approach to running AI agents: cron, env files, launchd, and a markdown decision log
0dev.to DevOps