inverse-scaling/NeQA
NeQA: Can Large Language Models Understand Negation in Multi-choice Questions? (Zhengping Zhou and Yuhui Zhang) General description This task takes an existing multiple-choice dataset and negates a part of each question to see if language models are sensitive to negation. The authors find that smaller language models display approximately random performance whereas the performance of larger models become significantly worse than random. Language models failing to… See the full description on the dataset page: https://huggingface.co/datasets/inverse-scaling/NeQA.
| Author / organization | inverse-scaling |
|---|---|
| License (as declared) | cc-by-sa-4.0 |
| Downloads | 199 (as reported by Hugging Face) |
| Likes | 4 |
| Created | 6 October 2022 |
| Last updated at source | 8 October 2022 |
Popularity, last 3 days
199 now (-2 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
Recent changes
- 16 Oct 2026 Description: NeQA: Can Large Language Models Understand Negation in Multi-choice Questions? (Zhengping Zhou and Yuhui Zhang) General description This task takes an existing multiple-choice dataset and negates a part of each question to see if language m → NeQA: Can Large Language Models Understand Negation in Multi-choice Questions? (Zhengping Zhou and Yuhui Zhang) General description This task takes an existing multiple-choice dataset and negates a part of each question to see if language m
Changes detected by Silytics between refreshes of the source.
More from inverse-scaling
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.