Dataset · Hugging Face

fengluoqiuwu/owt-bucket

Name: owt-bucket
Creator: fengluoqiuwu
License: mit
Keywords: task_categories:text-generation, language:en, license:mit, size_categories:1M<n<10M, format:parquet, modality:tabular, library:datasets, library:dask, library:polars, library:mlcroissant, region:us, openwebtext, owt, gpt2, sentence-segmentation

OWT GPT-2 sentence segments (buckets 256 / 512 / 1024 / 2048) Tokenized sentence/paragraph segments of OpenWebText (Skylion007/openwebtext, revision main), encoded with GPT-2 BPE plus three extra special tokens, then assigned to length buckets. This repository is a derived dataset. It does not rediscover or replace the original text corpus. Every input_ids sequence comes from documents in OpenWebText. Packaging / conversion code & this card: MIT (see LICENSE) Underlying web… See the full description on the dataset page: https://huggingface.co/datasets/fengluoqiuwu/owt-bucket.

View on Hugging FaceReport an issue

Author / organization	fengluoqiuwu
License (as declared)	mit
Downloads	223 (as reported by Hugging Face)
Likes	0
Created	25 August 2026
Last updated at source	25 August 2026

openwebtextowtgpt2sentence-segmentationlength-bucketinglanguage-modeling

Embed this entry

<iframe src="https://silytics.si/embed/item/f5e5bb74-ce7f-43dd-8a74-fc0cc81adac1" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

223 now (+1 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.