AntonKorznikov/SparseTransformer-dashboards

Sparse Transformer: neuron dashboards (M=32, K=8) Activation dashboards for all 40,960 MLP neurons (5 layers × 8,192) of the primary Sparse Transformer model main_mlp_mult_32_K_8 from the paper "Sparse Transformer: a Controlled Testbed for Mechanistic Interpretability". Model weights: AntonKorznikov/SparseTransformer Code: github.com/AntonKorznikov/SparseTransformer (dashboards/create_sae_dashboard.py regenerates these files) Each neuron page shows its top-activating… See the full description on the dataset page: https://huggingface.co/datasets/AntonKorznikov/SparseTransformer-dashboards.

<iframe src="https://silytics.si/embed/item/4030c6d5-463f-485e-a996-62d9025cbe8c" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.