Dataset · Hugging Face

OmniGUI/OmniGUI

Name: OmniGUI
Creator: OmniGUI
License: cc-by-nc-sa-4.0
Keywords: task_categories:image-text-to-text, task_categories:video-text-to-text, task_categories:audio-text-to-text, license:cc-by-nc-sa-4.0, size_categories:1K<n<10K, modality:audio, modality:image, modality:video, library:datasets, library:mlcroissant, arxiv:2605.18758, region:us, agent, gui, multimodal

OmniGUI: Benchmarking GUI Agents in Omni-Modal Smartphone Environments [🍎 Project Page] [📖 arXiv Paper] [📊 Dataset] [💻 GitHub] [🏆 Leaderboard] OmniGUI is a step-level GUI agent benchmark designed for omni-modal smartphone interaction. At each action step, the agent receives interleaved multimodal observations, including static screenshots, synchronous audio cues, short video clips, and action history, and must predict the next GUI action such as TAP or TYPE. The… See the full description on the dataset page: https://huggingface.co/datasets/OmniGUI/OmniGUI.

View on Hugging FaceReport an issue

Author / organization	OmniGUI
License (as declared)	cc-by-nc-sa-4.0
Downloads	941 (as reported by Hugging Face)
Likes	3
Created	16 March 2026
Last updated at source	29 September 2026

agentguimultimodalsmartphone

Embed this entry

<iframe src="https://silytics.si/embed/item/66015f7f-68ba-4f0c-a0c9-e3c7e9bdad4b" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.