inverse-scaling/redefine-math
redefine-math (Xudong Shen) General description In this task, the author tests whether language models are able to work with common symbols when they are redefined to mean something else. The author finds that larger models are more likely to pick the answer corresponding to the original definition rather than the redefined meaning, relative to smaller models. This task demonstrates that it is difficult for language models to work with new information given at… See the full description on the dataset page: https://huggingface.co/datasets/inverse-scaling/redefine-math.
| Author / organization | inverse-scaling |
|---|---|
| License (as declared) | cc-by-sa-4.0 |
| Downloads | 173 (as reported by Hugging Face) |
| Likes | 2 |
| Created | 8 October 2022 |
| Last updated at source | 8 October 2022 |
Popularity, last 3 days
173 now (+21 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
Recent changes
- 16 Oct 2026 Description: redefine-math (Xudong Shen) General description In this task, the author tests whether language models are able to work with common symbols when they are redefined to mean something else. The author finds that larger models are more likely → redefine-math (Xudong Shen) General description In this task, the author tests whether language models are able to work with common symbols when they are redefined to mean something else. The author finds that larger models are more likely
Changes detected by Silytics between refreshes of the source.
More from inverse-scaling
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.