Dataset · Hugging Face

EleutherAI/bergson-wikitext-2-4656-chunks

Name: bergson-wikitext-2-4656-chunks
Creator: EleutherAI
License: cc-by-sa-3.0
Keywords: task_categories:text-generation, language:en, license:cc-by-sa-3.0, size_categories:1K<n<10K, format:parquet, format:optimized-parquet, library:datasets, library:pandas, library:polars, library:mlcroissant, arxiv:2405.12186, region:us, wikitext, gpt2, influence-functions

bergson-wikitext-2-4656-chunks Pre-tokenized WikiText-2 in fixed 512-token GPT-2 chunks, used by the bergson WikiText-2 / GPT-2 data-attribution replication of Bae et al. 2024 (Training Data Attribution via Approximate Unrolled Differentiation). Each row is one 512-token document (one block of the concatenated corpus). Split Rows train 4656 validation 481 Columns: input_ids — list[int32], length 512 (GPT-2 BPE token ids) length — int64, always 512 Load with… See the full description on the dataset page: https://huggingface.co/datasets/EleutherAI/bergson-wikitext-2-4656-chunks.

View on Hugging FaceReport an issue

Author / organization	EleutherAI
License (as declared)	cc-by-sa-3.0
Downloads	444 (as reported by Hugging Face)
Likes	0
Created	1 August 2026
Last updated at source	2 August 2026

wikitextgpt2influence-functionsdata-attribution

Embed this entry

<iframe src="https://silytics.si/embed/item/b35e5581-07c7-4caf-9bfe-a8f52e40c882" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

444 now (+113 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

More from EleutherAI

EleutherAI/hendrycks_mathDataset
EleutherAI/lambada_openaiDataset
EleutherAI/wikitext_document_levelDataset
EleutherAI/headqaDataset
EleutherAI/proof-pile-2Dataset
EleutherAI/asdivDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.