Sign inGet started
Dataset · Hugging Face

ceselder/kimi-k3-olens-heldout-activations

Kimi-K3 oracle-lens held-out rows with layer-59 activations What this is. The two held-out files of the Kimi-K3 oracle-lens project (collection): 2 x 16,342 web-text positions of moonshotai/Kimi-K3 with the model's layer-59 activation at each position (both Attention-Residuals read vectors, h_sum and h_mix, 7,168-d fp16), the exact next-token entropy, and -- for the 1,390 + 7,417 "kept" rows -- Kimi-K3's own sampled continuation (the lens / reconstructor target). Every number in… See the full description on the dataset page: https://huggingface.co/datasets/ceselder/kimi-k3-olens-heldout-activa

Author / organizationceselder
License (as declared)other
Downloads0 (as reported by Hugging Face)
Likes0
Created25 October 2026
Last updated at source25 October 2026
interpretabilityoracle-lensolenskimi-k3activationsattention-residuals
Embed this entry
<iframe src="https://silytics.si/embed/item/adf22267-8e90-4e45-87ff-31a12ae8d4f9" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Recent changes

  • 25 Oct 2026 License: none → other
  • 25 Oct 2026 Description: none → Kimi-K3 oracle-lens held-out rows with layer-59 activations What this is. The two held-out files of the Kimi-K3 oracle-lens project (collection): 2 x 16,342 web-text positions of moonshotai/Kimi-K3 with the model's layer-59 activation at ea
  • 25 Oct 2026 Topics added interpretability, oracle-lens, olens, kimi-k3, activations, attention-residuals

Changes detected by Silytics between refreshes of the source.

More from ceselder

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 25 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.