jmichaelov/lm_syneval
Dataset Card for Targeted Syntactic Evaluation of Language Models (LM-SynEval) We present a dataset for evaluating the grammaticality of the predictions of a language model. We automatically construct a large number of minimally different pairs of English sentences, each consisting of a grammatical and an ungrammatical sentence. The sentence pairs represent different variations of structure-sensitive phenomena: subject-verb agreement, reflexive anaphora and negative polarity… See the full description on the dataset page: https://huggingface.co/datasets/jmichaelov/lm_syneval.
| Author / organization | jmichaelov |
|---|---|
| License (as declared) | mit |
| Downloads | 178 (as reported by Hugging Face) |
| Likes | 0 |
| Created | 30 April 2025 |
| Last updated at source | 17 July 2025 |
Popularity, last 3 days
178 now (-7 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
Recent changes
- 16 Oct 2026 Description: Dataset Card for Targeted Syntactic Evaluation of Language Models (LM-SynEval) We present a dataset for evaluating the grammaticality of the predictions of a language model. We automatically construct a large number of minimally different p → Dataset Card for Targeted Syntactic Evaluation of Language Models (LM-SynEval) We present a dataset for evaluating the grammaticality of the predictions of a language model. We automatically construct a large number of minimally different p
Changes detected by Silytics between refreshes of the source.
More from jmichaelov
- jmichaelov/blimp_nlDataset
- jmichaelov/bhsDataset
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.