Sign inGet started
Dataset · Hugging Face

ibm-research/knowledge_consistency_of_LLMs

What it is: Each dataset in this delivery is made up of query clusters that test an aspect of the consistency of the LLM knowledge about a particular domain. All the questions in each cluster are meant to be answered either 'yes' or 'no'. When the answers vary within a cluster, the knowledge is said to be inconsistent. When all the questions in a cluster are answered 'no' when the expected answer is 'yes' (or viceversa), the knowledge is said to be 'incomplete' (i.e., maybe the… See the full description on the dataset page: https://huggingface.co/datasets/ibm-research/knowledge_consistency_of_

Author / organizationibm-research
License (as declared)apache-2.0
Downloads211 (as reported by Hugging Face)
Likes3
Created9 August 2024
Last updated at source2 November 2025
financemusicmedicalfoodacademic disciplinesnatural disasterssoftwaresynthetic
Embed this entry
<iframe src="https://silytics.si/embed/item/7d2d50c3-5035-471d-8ff9-a9c1625ce777" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Recent changes

  • 16 Oct 2026 Description: What it is: Each dataset in this delivery is made up of query clusters that test an aspect of the consistency of the LLM knowledge about a particular domain. All the questions in each cluster are meant to be answered either 'yes' or 'no'. W → What it is: Each dataset in this delivery is made up of query clusters that test an aspect of the consistency of the LLM knowledge about a particular domain. All the questions in each cluster are meant to be answered either 'yes' or 'no'. W

Changes detected by Silytics between refreshes of the source.

More from ibm-research

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.