floatai/TKEval
Dataset Card for TKEval Contents Dataset Description Dataset Structure Dataset Splits Citation Dataset Description The curse of tokenization: Language models typically tokenize raw text into sequences of subword identifiers from a predefined vocabulary, a process inherently sensitive to typographical errors, length variations, and largely oblivious to the internal structure of tokens. TKEval is an evalution benchmark for systematicly assessing the… See the full description on the dataset page: https://huggingface.co/datasets/floatai/TKEval.
| Author / organization | floatai |
|---|---|
| License (as declared) | apache-2.0 |
| Downloads | 2.7K (as reported by Hugging Face) |
| Likes | 2 |
| Created | 10 December 2024 |
| Last updated at source | 11 December 2024 |
Popularity, last 2 days
2,712 now (-227 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
Recent changes
- 16 Oct 2026 Description: Dataset Card for TKEval Contents Dataset Description Dataset Structure Dataset Splits Citation Dataset Description The curse of tokenization: Language models typically tokenize raw text into sequences of subword identifiers from a predefine → Dataset Card for TKEval Contents Dataset Description Dataset Structure Dataset Splits Citation Dataset Description The curse of tokenization: Language models typically tokenize raw text into sequences of subword identifiers from a predefine
Changes detected by Silytics between refreshes of the source.
More from floatai
- floatai/HumanEval-XLDataset
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.