Dataset · Hugging Face

JingmingChen/UserIntentBench

Name: UserIntentBench
Creator: JingmingChen
License: cc-by-4.0
Keywords: task_categories:text-generation, task_categories:image-to-text, language:en, license:cc-by-4.0, license:cc-by-sa-4.0, license:cc-by-nc-sa-4.0, size_categories:n<1K, format:parquet, modality:image, modality:text, library:datasets, library:pandas, library:polars, library:mlcroissant, region:us

UserIntentBench UserIntentBench is a benchmark for measuring whether LLM and VLM agents can recover, track, and re-align with user intent over long-horizon agentic tasks. Real user intent is rarely fully specified and rarely fixed: it is latent (only partially expressed at the start) and shifting (refined, redirected, or replaced mid-session). The benchmark represents the user's full intent as a structured, web-grounded intent graph that the evaluation harness knows in full but… See the full description on the dataset page: https://huggingface.co/datasets/JingmingChen/UserIntentBench.

View on Hugging FaceReport an issue

Author / organization	JingmingChen
License (as declared)	cc-by-4.0
Downloads	135 (as reported by Hugging Face)
Likes	0
Created	27 July 2026
Last updated at source	27 July 2026

benchmarkagentsdeep-researchcodingclarifying-questionsuser-intentmultimodalllm-evaluation

Embed this entry

<iframe src="https://silytics.si/embed/item/9415ea81-69df-4928-b1c9-7d49feb9d166" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

More from JingmingChen

JingmingChen/PathRefinerDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.