Sign inGet started
Paper · arXiv

FigAct: Turning Scientific Figures into Active Canvases for Explanation

Scientific figures are designed to communicate information visually, yet MLLMs typically explain them by translating their visual content back into text. This requires readers to manually map the resulting explanations back to the figure. Inspired by how people present visual information, we introduce FigAct, a framework that transforms static scientific figures into question-conditioned visual presentations by acting directly on their existing graphical elements. Like a human presenter, FigAct generates a sequence of short narrations, grounds each narration in the corresponding visual evidence, and applies visual actions to guide the viewer's attention. We develop a hierarchical search s...

AuthorsShishi Xiao, Zichao Wang, Alexa Siu et al.
Primary categorycs.AI
Published28 September 2026
Last updated at source28 September 2026
cs.AI
Embed this entry
<iframe src="https://silytics.si/embed/item/fe934a26-fbb8-4b4f-b8f6-ecdde8c35632" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.