Transcription Policy as a Latent Variable: Activating Controllable Verbatim ASR with Word-Level Timing
Modern ASR models trained on heterogeneously annotated data treat transcription style (verbatim vs. intended) as an uncontrolled latent variable, causing measurable decoding instability, evaluation confounding (up to 60% of reported WER attributable to style mismatch), and unreliable word-level timing. We show that models already encode both styles; the challenge is controlled activation. Using coverage-aware decoder task tokens trained on parallel verbatim/intended transcript pairs, we raise German disfluency F1 from 10% to 79% zero-shot, despite English-only training. Full English-only fine-tuning surpasses all baselines in verbatim accuracy, disfluency detection, and intended-mode qual...
| Authors | Laurin Wagner, Mario Zusag, Bernhard Thallinger |
|---|---|
| Primary category | cs.CL |
| Published | 21 July 2026 |
| Last updated at source | 21 July 2026 |
Connected in the knowledge graph
- nyralabs/CrisperWhisper2.0_turboModel · cited by
- nyralabs/CrisperWhisper2.0_largeModel · cited by
- nyralabs/CrisperWhisper2.0_smallModel · cited by
- nyralabs/CrisperWhisper2.0_mediumModel · cited by
Models and datasets referencing this paper
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.