rippleripple/ProbMed
Paper: Worse than Random? An Embarrassingly Simple Probing Evaluation of Large Multimodal Models in Medical VQA Website: https://jackie-2000.github.io/probmed.github.io/ ProbMed: Created to rigorously evaluate LMMs’ readiness for real-life diagnostic tasks, particularly under adversarial conditions with a total of 57,132 question-answer pairs, averaging 9 pairs per image. Includes a diverse set of high-quality questions for each image, covering various diagnostic dimensions. Related files: QA… See the full description on the dataset page: https://huggingface.co/datasets/rippleripple/ProbMed.
| Author / organization | rippleripple |
|---|---|
| License (as declared) | mit |
| Downloads | 146 (as reported by Hugging Face) |
| Likes | 5 |
| Created | 2 June 2024 |
| Last updated at source | 16 May 2026 |
More from rippleripple
- rippleripple/iReasonDataset
- rippleripple/MMIRDataset
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.