Dataset · Hugging Face

vanyacohen/MET-Bench-Shell

Name: MET-Bench-Shell
Creator: vanyacohen
License: mit
Keywords: language:en, license:mit, size_categories:10K<n<100K, format:parquet, modality:image, modality:tabular, modality:text, library:datasets, library:pandas, library:polars, library:mlcroissant, arxiv:2502.10886, region:us, multimodal, entity-tracking

MET-Bench: Multimodal Entity Tracking for Evaluating the Limitations of Vision-Language and Reasoning Models Vanya Cohen and Raymond Mooney · ICML 2026 Paper · Project page · Load the dataset · Citation Domains: Chess · Shell Game · Minecraft MET-Bench evaluates entity state tracking across text and image modalities. This repository contains the Shell Game domain. Shell Game A ball is placed under one of three shells. The shells are swapped pairwise, and the goal… See the full description on the dataset page: https://huggingface.co/datasets/vanyacohen/MET-Bench-Shell.

View on Hugging FaceReport an issue

Author / organization	vanyacohen
License (as declared)	mit
Downloads	161 (as reported by Hugging Face)
Likes	0
Created	9 September 2026
Last updated at source	29 September 2026

multimodalentity-trackingreasoningsyntheticrlvr

Embed this entry

<iframe src="https://silytics.si/embed/item/9b29f997-da88-4f35-8e5c-94ab3280c1f7" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

More from vanyacohen

vanyacohen/MET-Bench-MinecraftDataset
vanyacohen/MET-Bench-ChessDataset
vanyacohen/MET-Bench-Minecraft-TrajectoriesDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.