Solving Physics Olympiad via Reinforcement Learning on Physics Simulators
We have witnessed remarkable advances in LLM reasoning capabilities with the advent of DeepSeek-R1. However, much of this progress has been fueled by the abundance of internet question-answer (QA) pairs, a major bottleneck going forward, since such data is limited in scale and concentrated mainly in domains like mathematics. In contrast, other sciences such as physics lack large-scale QA datasets to effectively train reasoning-capable models. In this work, we show that physics simulators can serve as a powerful alternative source of supervision for training LLMs for physical reasoning. We generate random scenes in physics engines, create synthetic question-answer pairs from simulated inte...
| Authors | Mihir Prabhudesai, Aryan Satpathy, Yangmin Li et al. |
|---|---|
| Primary category | cs.LG |
| Published | 13 April 2026 |
| Last updated at source | 13 April 2026 |
Connected in the knowledge graph
- mradermacher/Sim2Reason-7B-GGUFModel · cited by
- mradermacher/Sim2Reason-30B-GGUFModel · cited by
- mradermacher/Sim2Reason-3B-GGUFModel · cited by
- mradermacher/Sim2Reason-14B-GGUFModel · cited by
Models and datasets referencing this paper
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.