PeytonT/2m_papers_text

Deduped Paper Text Dataset This dataset merges an existing paper-text parquet export with one or more backfill parquet shards, then keeps exactly one row per canonical_paper_id. One row corresponds to one canonical arXiv paper. Where multiple versions are available, the merge keeps the strongest text row according to the repo's selection logic: prefer non-partial text, then prefer raw-PDF-derived text, then newer versions, then longer text. Important provenance note… See the full description on the dataset page: https://huggingface.co/datasets/PeytonT/2m_papers_text.

<iframe src="https://silytics.si/embed/item/61abf90c-7b6e-41c1-983a-45f2cc89e5e7" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.