gist-sparse-attention/GSA-PT-Qwen2-7B-Instruct-chunk8-chunk4-data
GSA-PT-Qwen2-7B-Instruct-chunk8-chunk4-data This is the continue pretraining dataset used for training GSA (Gist Sparse Attention) models based on Qwen2-7B-Instruct with chunk size chunk8-chunk4. Each sample is tokenized and formatted with GSA gist tokens for continue pretraining. Paper GSA: Gist Sparse Attention via Learnable Compression and Selective Unfolding Related Model yuzhenm/GSA-PT-Qwen2-7B-Instruct-chunk8-chunk4 — model trained on this… See the full description on the dataset page: https://huggingface.co/datasets/gist-sparse-attention/GSA-PT-Qwen2-7B-Instruct-chunk8-chunk4-data.
| Author / organization | gist-sparse-attention |
|---|---|
| License (as declared) | odc-by |
| Downloads | 143 (as reported by Hugging Face) |
| Likes | 0 |
| Created | 6 April 2026 |
| Last updated at source | 6 April 2026 |
Popularity, last 5 days
143 now (+5 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
Recent changes
- 16 Oct 2026 Description: GSA-PT-Qwen2-7B-Instruct-chunk8-chunk4-data This is the continue pretraining dataset used for training GSA (Gist Sparse Attention) models based on Qwen2-7B-Instruct with chunk size chunk8-chunk4. Each sample is tokenized and formatted with → GSA-PT-Qwen2-7B-Instruct-chunk8-chunk4-data This is the continue pretraining dataset used for training GSA (Gist Sparse Attention) models based on Qwen2-7B-Instruct with chunk size chunk8-chunk4. Each sample is tokenized and formatted with
Changes detected by Silytics between refreshes of the source.
More from gist-sparse-attention
- gist-sparse-attention/GSA-FT-Qwen2-7B-Instruct-chunk8-chunk4-dataDataset
- gist-sparse-attention/GSA-PT-Qwen2-7B-Instruct-chunk16-dataDataset
- gist-sparse-attention/GSA-PT-Qwen2-7B-Instruct-chunk32-dataDataset
- gist-sparse-attention/GSA-PT-Llama-3.2-1B-chunk16-dataDataset
- gist-sparse-attention/GSA-FT-Qwen2-7B-Instruct-chunk32-dataDataset
- gist-sparse-attention/GSA-PT-Qwen2-7B-Instruct-chunk8-dataDataset
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 20 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.