Sign inGet started
Paper · arXiv

Physics-R1: An Audited Olympiad Corpus and Released Verifiers for Visual Physics Reasoning

Trackable improvement in multimodal physics reasoning rests on a training-and-evaluation system that is itself rarely verified: the corpora a model trains on, the reward it is optimized against, and the benchmarks and judges that score it. We audit this system end to end and find that standard construction practices systematically distort measurement: contamination slips past n-gram deduplication, translation degrades problems, saturated multiple-choice formats overstate capability, partial-credit training rewards are easier to exploit than to earn, and open-ended grading silently depends on the choice of judge. Left unverified, these distortions inflate reported progress and leak test kn...

AuthorsShan Yang
Primary categorycs.CL
Published13 May 2026
Last updated at source28 August 2026
cs.CL
Embed this entry
<iframe src="https://silytics.si/embed/item/0d03e3f2-4c10-4527-9d3b-83e639773f2e" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Connected in the knowledge graph

Explore this entry in the graph

Models and datasets referencing this paper

Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.