bx6d/n1m19-test1018-memory-tool-sweep
N1M19 (test_1018) — memory × tool sweep over 6 vision-language models Full trajectories of vision-language-model agents on N1M19, an embodied search task in AI2-THOR. Each instance gives the agent 7 requirements and a pool of 20 ProcTHOR houses; exactly one house (the golden one) meets all 7. The agent walks through the houses — it sees a first-person camera view and a minimap every step — and has to submit the golden house. Random choice scores 1 in 20. Status: Gemma-4-31B… See the full description on the dataset page: https://huggingface.co/datasets/bx6d/n1m19-test1018-memory-tool-sweep.
| Author / organization | bx6d |
|---|---|
| Downloads | 0 (as reported by Hugging Face) |
| Likes | 1 |
| Created | 23 October 2026 |
| Last updated at source | 23 October 2026 |
Recent changes
- 23 Oct 2026 Description: none → N1M19 (test_1018) — memory × tool sweep over 6 vision-language models Full trajectories of vision-language-model agents on N1M19, an embodied search task in AI2-THOR. Each instance gives the agent 7 requirements and a pool of 20 ProcTHOR ho
- 23 Oct 2026 Topics added embodied-ai, vision-language-models, agents, ai2-thor, procthor, benchmark
Changes detected by Silytics between refreshes of the source.
More from bx6d
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 23 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.