MMTB: Evaluating Terminal Agents on Multimedia-File Tasks
Terminals provide a powerful interface for AI agents by exposing diverse tools for automating complex workflows, yet existing terminal-agent benchmarks largely focus on tasks grounded in text, code, and structured files. However, many real-world workflows require practitioners to work directly with audio and video files. Working with such multimedia files calls for terminal agents not only to understand multimedia content, but also to convert auditory and visual evidence across related files into appropriate actions. To evaluate terminal agents on multimedia-file tasks, we introduce MultiMedia-TerminalBench (MMTB), a benchmark of 105 tasks across 5 meta-categories where terminal agents di...
| Authors | Chiyeong Heo, Jaechang Kim, Junhyuk Kwon et al. |
|---|---|
| Primary category | cs.MM |
| Published | 8 May 2026 |
| Last updated at source | 8 May 2026 |
Connected in the knowledge graph
- mm-tbench/mmtb-mediaDataset · cited by
Models and datasets referencing this paper
- mm-tbench/mmtb-mediaDataset
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.