Dataset · Hugging Face

BAAI/ROME

Name: ROME
Creator: BAAI
License: cc-by-sa-4.0
Keywords: task_categories:image-text-to-text, language:en, license:cc-by-sa-4.0, size_categories:n<1K, format:parquet, modality:image, modality:text, library:datasets, library:pandas, library:mlcroissant, library:polars, arxiv:2509.17177, region:us, benchmark, reasoning

🏠Project Page & Leaderboard | 💻Code | 📄Paper | 🤗Data | 🤗Evaluation Response This repository contains a visual reasoning benchmark named ROME from the paper FlagEval Findings Report: A Preliminary Evaluation of Large Reasoning Models on Automatically Verifiable Textual and Visual Questions. ROME include 8 subtasks (281 high-quality questions in total). Each sample has been verified to ensure that images are necessary to answer correctly: Academic questions from college courses Diagrams… See the full description on the dataset page: https://huggingface.co/datasets/BAAI/ROME.

View on Hugging FaceReport an issue

Author / organization	BAAI
License (as declared)	cc-by-sa-4.0
Downloads	391 (as reported by Hugging Face)
Likes	5
Created	23 September 2025
Last updated at source	25 September 2025

benchmarkreasoningvlm

Embed this entry

<iframe src="https://silytics.si/embed/item/72523ca3-31f7-469b-85ae-b85f6b0e81da" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

More from BAAI

BAAI/TACODataset
BAAI/ShareRobotDataset
BAAI/CCI3-HQDataset
BAAI/IndustryCorpus2_subject_education_educationDataset
BAAI/IndustryCorpus2_current_affairs_government_administrationDataset
BAAI/IndustryCorpusDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.