Sign inGet started
Dataset · Hugging Face

Diamegs/pre-training-tokens

PIT-LLM training data This repository holds the training data of the point-in-time (PIT) language models from Scaling Point-in-Time Language Models: Enabling Economic Evaluation of Embeddings (Bryan Kelly, Semyon Malamud, Johannes Schwab, Teng Andrea Xu; NeurIPS 2026 Evaluations & Datasets Track, arXiv:2607.11889). A point-in-time model is trained only on text that existed up to a given date, so it cannot leak information from the future into backtests or historical studies. To… See the full description on the dataset page: https://huggingface.co/datasets/Diamegs/pre-training-tokens.

Author / organizationDiamegs
License (as declared)other
Downloads629 (as reported by Hugging Face)
Likes0
Created28 September 2026
Last updated at source16 October 2026
point-in-timelookahead-biastemporalpretraininginstruction-tuningfinancefineweb
Embed this entry
<iframe src="https://silytics.si/embed/item/22a7b918-f008-4ff5-b7aa-a7adda85ee28" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

629 now (+34 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

Connected in the knowledge graph

Explore this entry in the graph

Recent changes

  • 17 Oct 2026 License: none → other
  • 17 Oct 2026 Description: none → PIT-LLM training data This repository holds the training data of the point-in-time (PIT) language models from Scaling Point-in-Time Language Models: Enabling Economic Evaluation of Embeddings (Bryan Kelly, Semyon Malamud, Johannes Schwab, T
  • 17 Oct 2026 Topics added task_categories:text-generation, point-in-time, lookahead-bias, temporal, pretraining, instruction-tuning, finance, fineweb

Changes detected by Silytics between refreshes of the source.

Related papers

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.