lmsys/mt_bench_human_judgments
Content This dataset contains 3.3K expert-level pairwise human preferences for model responses generated by 6 models in response to 80 MT-bench questions. The 6 models are GPT-4, GPT-3.5, Claud-v1, Vicuna-13B, Alpaca-13B, and LLaMA-13B. The annotators are mostly graduate students with expertise in the topic areas of each of the questions. The details of data collection can be found in our paper. Agreement Calculation This Colab notebook shows how to compute the… See the full description on the dataset page: https://huggingface.co/datasets/lmsys/mt_bench_human_judgments.
| Author / organization | lmsys |
|---|---|
| License (as declared) | cc-by-4.0 |
| Downloads | 3.7K (as reported by Hugging Face) |
| Likes | 150 |
| Created | 4 July 2023 |
| Last updated at source | 20 July 2023 |
Popularity, last 2 days
3,652 now (+178 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
More from lmsys
- lmsys/toxic-chatDataset
- lmsys/lmsys-chat-1mDataset
- lmsys/chatbot_arena_conversationsDataset
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.