Sign inGet started
Paper · arXiv

cotomi Act: Learning to Automate Work by Watching You

What if a browser agent could learn your work simply by watching you do it? We present cotomi Act, a browser-based computer-using agent that combines reliable multi-step task execution with persistent organizational knowledge learned from user behavior. For execution, an agent scaffold with adaptive lazy observation, verbal-diff-based history compression, coarse-grained actions, and test-time scaling via best-of-N action selection achieves 80.4% on the 179-task WebArena human-evaluation subset, exceeding the reported 78.2% human baseline. For organizational knowledge, a behavior-to-knowledge pipeline passively observes the user's browsing and progressively abstracts it into artifacts (tas...

AuthorsMasafumi Oyamada, Kunihiro Takeoka, Kosuke Akimoto et al.
Primary categorycs.AI
Published4 May 2026
Last updated at source4 May 2026
cs.AI
Embed this entry
<iframe src="https://silytics.si/embed/item/8d0761bf-2b51-477d-91f7-a69bcdd3bc1e" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.