Sign inGet started
Dataset · Hugging Face

togethercomputer/RedPajama-Data-Instruct

Dataset Summary RedPajama-Instruct-Data is curated from a diverse collection of NLP tasks from both P3 (BigScience) and Natural Instruction (AI2), and conduct aggressive decontamination against HELM, in two steps: (1) We first conduct semantic search using each validation example in HELM as the query and get top-100 similar instances from the Instruct data set and check tasks that have any returned instances overlapping (using 10-Gram) with the validation example. We remove the… See the full description on the dataset page: https://huggingface.co/datasets/togethercomputer/RedPajama-Data-Instru

Author / organizationtogethercomputer
License (as declared)apache-2.0
Downloads244 (as reported by Hugging Face)
Likes36
Created5 June 2023
Last updated at source6 June 2023
Embed this entry
<iframe src="https://silytics.si/embed/item/86ae4683-914c-46c6-8405-8d17c1ebea75" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Connected in the knowledge graph

Explore this entry in the graph

More from togethercomputer

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.