florin-hf/wiki_dump2018_no_duplicates
Wikipedia Dump without Duplicates Dataset Summary This is a cleaned and de-duplicated version of the English Wikipedia dump dated December 20, 2018. Originally sourced from the DPR repository, it has been processed to remove duplicates, resulting in a final count of 20,970,784 passages, each consisting of 100 words. The original corpus is available for download via this link. The corpus is used in the research paper A Tale of Trust and Accuracy: Base vs. Instruct LLMs in… See the full description on the dataset page: https://huggingface.co/datasets/florin-hf/wiki_dump2018_no_duplicates.
| Author / organization | florin-hf |
|---|---|
| Downloads | 144 (as reported by Hugging Face) |
| Likes | 0 |
| Created | 2 July 2024 |
| Last updated at source | 3 July 2024 |
More from florin-hf
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.