Dataset · Hugging Face

dimhold/cutoff-probe

Name: cutoff-probe
Creator: dimhold
License: mit
Keywords: task_categories:question-answering, language:en, license:mit, size_categories:1K<n<10K, format:json, modality:tabular, modality:text, library:datasets, library:pandas, library:polars, library:mlcroissant, region:us, llm-evaluation, knowledge-cutoff, claude

cutoff-probe Author: Dmitriy Semenkevich (dimhold) This dataset measures where 7 Claude models actually stop knowing package releases: 552 npm and PyPI releases dated by the registries, 12 per month from 2023-01 to 2026-10, plus 200 versions that do not exist as a control. Headline, from the repository README: "The 5.5 generation (the 4 models stated as Jun 2026, fable-5-1 included) falls to half of its 2024 level 6 to 9 months before the stated date: the last month at or above… See the full description on the dataset page: https://huggingface.co/datasets/dimhold/cutoff-probe.

View on Hugging FaceReport an issue

Author / organization	dimhold
License (as declared)	mit
Downloads	0 (as reported by Hugging Face)
Likes	0
Created	22 October 2026
Last updated at source	22 October 2026

llm-evaluationknowledge-cutoffclaudenpmpypi

Embed this entry

<iframe src="https://silytics.si/embed/item/628a17af-e771-4980-9b25-038a02846323" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Recent changes

22 Oct 2026 License: cc-by-4.0 → mit

Changes detected by Silytics between refreshes of the source.

More from dimhold

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 22 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.