Sign inGet started
Paper · arXiv

Chartography: A Benchmark for Professional Chart Understanding

Professionals across medicine, engineering, finance, manufacturing, and the sciences often make consequential decisions from charts. Existing chart benchmarks do not sufficiently measure this ability: they are dominated by bar, line, and pie formats, rely on shorter reasoning chains, and are nearing saturation, with frontier models already scoring 80-90%. We introduce Chartography, a benchmark of 100 tasks that pair charts drawn from professional practice, in domain-specific formats that standard chart benchmarks rarely include, with questions written by professionals who read these charts for a living and independently verified by three additional experts. In an evaluation of 30 frontier...

AuthorsSuhaas Garre, Chris Mutty, Sushant Mehta et al.
Primary categorycs.CV
Published11 August 2026
Last updated at source11 August 2026
cs.CV
Embed this entry
<iframe src="https://silytics.si/embed/item/a209c677-ec9f-41df-80c6-bd4fcdd4f8db" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.