MMSkills: Towards Multimodal Skills for General Visual Agents
Reusable skills have become a core substrate for improving agent capabilities, yet most existing skill packages encode reusable behavior primarily as textual prompts, executable code, or learned routines. For visual agents, however, procedural knowledge is inherently multimodal: reuse depends not only on what operation to perform, but also on recognizing the relevant state, interpreting visual evidence of progress or failure, and deciding what to do next. We formalize this requirement as multimodal procedural knowledge and address three practical challenges: (I) what a multimodal skill package should contain; (II) where such packages can be derived from public interaction experience; and ...
| Authors | Kangning Zhang, Shuai Shao, Qingyao Li et al. |
|---|---|
| Primary category | cs.AI |
| Published | 13 May 2026 |
| Last updated at source | 1 June 2026 |
Connected in the knowledge graph
- zhangkangning/mmskillsDataset · cited by
Models and datasets referencing this paper
- zhangkangning/mmskillsDataset
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.