axiotic/ogma-v2-10b-distillation
ogma-v2-10b-distillation Teacher-feature distillation corpus for the Ogma-v2 10B run. Each row is a FineWeb-Edu document paired with a 256-dim Qwen3-Embedding-0.6B teacher embedding (Matryoshka Representation Learning, truncated to the first 256 dims and stored as float16). Splits split rows notes train 13,860,000 merged corpus minus the two 70k val slices val_uniform 70,000 uniform-random sample over the full 14M corpus, seed 20260709 val_tail 70… See the full description on the dataset page: https://huggingface.co/datasets/axiotic/ogma-v2-10b-distillation.
| Author / organization | axiotic |
|---|---|
| License (as declared) | odc-by |
| Downloads | 140 (as reported by Hugging Face) |
| Likes | 0 |
| Created | 9 July 2026 |
| Last updated at source | 9 July 2026 |
Popularity, last 3 days
140 now (+6 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.