BEE-spoke-data/wikipedia-20230901.en-deduped
wikipedia - 20230901.en - deduped purpose: train with less data while maintaining (most) of the quality This is really more of a "high quality diverse sample" rather than "we are trying to remove literal duplicate documents". Source dataset: graelo/wikipedia. configs default command: python -m text_dedup.minhash \ --path $ds_name \ --name $dataset_config \ --split $data_split \ --cache_dir "./cache" \ --output $out_dir \ --column… See the full description on the dataset page: https://huggingface.co/datasets/BEE-spoke-data/wikipedia-20230901.en-deduped.
| Author / organization | BEE-spoke-data |
|---|---|
| License (as declared) | cc-by-sa-3.0 |
| Downloads | 505 (as reported by Hugging Face) |
| Likes | 6 |
| Created | 23 October 2023 |
| Last updated at source | 29 December 2025 |
Popularity, last 5 days
505 now (+26 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
Connected in the knowledge graph
- BEE-spoke-data/smol_llama-101M-GQAModel · used to train
- afrideva/smol_llama-101M-GQA-GGUFModel · used to train
- bartowski/pszemraj_jamba-900M-v0.13-KIx2-GGUFModel · used to train
- BEE-spoke-data/mega-ar-126m-4kModel · used to train
Recent changes
- 16 Oct 2026 Description: wikipedia - 20230901.en - deduped purpose: train with less data while maintaining (most) of the quality This is really more of a "high quality diverse sample" rather than "we are trying to remove literal duplicate documents". Source dataset → wikipedia - 20230901.en - deduped purpose: train with less data while maintaining (most) of the quality This is really more of a "high quality diverse sample" rather than "we are trying to remove literal duplicate documents". Source dataset
Changes detected by Silytics between refreshes of the source.
More from BEE-spoke-data
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 20 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.