nyu-dice-lab/sos-artifacts
This repository contains a range of Arena-Hard-Auto benchmark artifacts sourced as part of the 2024 paper Style Outweighs Substance. Repository Structure Model Responses for Arena Hard Auto Questions: data/ArenaHardAuto/model_answer Our standard reference model for pairwise comparisons was gpt-4-0314. Our standard set of comparison models was: Llama-3-8B Variants: bagel-8b-v1.0, Llama-3-8B-Magpie-Align-SFT-v0.2, Llama-3-8B-Magpie-Align-v0.2, Llama-3-8B-Tulu-330K, Llama-3-8B-WildChat… See the full description on the dataset page: https://huggingface.co/datasets/nyu-dice-lab/sos-artifacts.
| Author / organization | nyu-dice-lab |
|---|---|
| License (as declared) | mit |
| Downloads | 1.4K (as reported by Hugging Face) |
| Likes | 0 |
| Created | 31 March 2025 |
| Last updated at source | 21 May 2025 |
Popularity, last 3 days
1,382 now (+3 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
More from nyu-dice-lab
- nyu-dice-lab/wavepulse-radio-raw-transcriptsDataset
- nyu-dice-lab/lm-eval-results-princeton-nlp-Llama-3-Base-8B-SFT-RDPO-privateDataset
- nyu-dice-lab/lm-eval-results-hkust-nlp-dart-math-llama3-8b-prop2diff-privateDataset
- nyu-dice-lab/wavepulse-radio-summarized-transcriptsDataset
- nyu-dice-lab/wildchat-50m-extended-resultsDataset
- nyu-dice-lab/lm-eval-results-AurelPx-Pegasus-7b-slerp-privateDataset
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.