FreedomIntelligence/DitingBench
Diting Benchmark Our paperGithub Our benchmark is designed to evaluate the speech comprehension capabilities of Speech LLMs. We tested both humans and Speech LLMs in terms of speech understanding and provided further analysis of the results, along with a comparative study between the two. This offers insights for the future development of Speech LLMs. For more details, please refer to our paper. Result Level Task Human Baseline GPT-4o MuLLaMA GAMA SALMONN… See the full description on the dataset page: https://huggingface.co/datasets/FreedomIntelligence/DitingBench.
| Author / organization | FreedomIntelligence |
|---|---|
| License (as declared) | mit |
| Downloads | 1.2K (as reported by Hugging Face) |
| Likes | 1 |
| Created | 15 May 2025 |
| Last updated at source | 4 June 2025 |
More from FreedomIntelligence
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.