Sign inGet started
Dataset · Hugging Face

toksuite/toksuite_chinese

Dataset Card for Tokenization Robustness TokSuite Benchmark (Chinese Collection) Dataset Description This dataset is part of TokSuite, a comprehensive benchmark designed to measure how different tokenization strategies affect language model performance and robustness. This specific subset contains Chinese language multiple-choice text completion questions with various real-world perturbations that test tokenizer robustness. Curated by: R3… See the full description on the dataset page: https://huggingface.co/datasets/toksuite/toksuite_chinese.

Author / organizationtoksuite
License (as declared)mit
Downloads359 (as reported by Hugging Face)
Likes0
Created16 September 2025
Last updated at source21 January 2026
multilingualtokenizationrobustness
Embed this entry
<iframe src="https://silytics.si/embed/item/cfdc03bd-13f5-47ab-82ca-a7e3b47c442a" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 2 days

359 now (+6 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

Recent changes

  • 17 Oct 2026 Description: Dataset Card for Tokenization Robustness TokSuite Benchmark (Chinese Collection) Dataset Description This dataset is part of TokSuite, a comprehensive benchmark designed to measure how different tokenization strategies affect language model → Dataset Card for Tokenization Robustness TokSuite Benchmark (Chinese Collection) Dataset Description This dataset is part of TokSuite, a comprehensive benchmark designed to measure how different tokenization strategies affect language model

Changes detected by Silytics between refreshes of the source.

More from toksuite

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.