LocalLLaMA/deepswe-mini

deepswe-mini 16 of the 113 tasks in DeepSWE v1.1, picked so that running just these ranks models the same way the full benchmark does. DeepSWE is a good benchmark and an expensive one. Every task is a long-horizon feature request in its own container, and a full pass takes close to two days of agent time run one task at a time. If you are comparing models, agent harnesses or prompts, and the differences you care about are more than a few points, these 16 tasks give you the same… See the full description on the dataset page: https://huggingface.co/datasets/LocalLLaMA/deepswe-mini.

<iframe src="https://silytics.si/embed/item/aaa792f2-bf01-4ca6-a882-9612534eeb4b" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.