lthn/LEM-Eval

LEM-Eval The 8-PAC benchmark runner for the Lemma model family. A HuggingFace dataset repo used as a tool-shaped "github" — the entire scorer lives here, anyone clones it, installs once, and the worker machines chug along advancing per-model canons in lockstep. Multiple workers farm different targets in parallel — each target declares a type (mlx or gguf) in targets.yaml, and workers filter by the backends they can actually run (capability probe or LEM_TYPES env). Partition falls… See the full description on the dataset page: https://huggingface.co/datasets/lthn/LEM-Eval.

<iframe src="https://silytics.si/embed/item/e7f044d8-77e1-4b9d-98fb-cfd98383aa8d" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.