Dataset · Hugging Face

kajuma/CC-news-2024-July-October-cleaned

Name: CC-news-2024-July-October-cleaned
Creator: kajuma
License: odc-by
Keywords: task_categories:text-generation, language:ja, license:odc-by, size_categories:100K<n<1M, format:parquet, modality:text, library:datasets, library:dask, library:mlcroissant, library:polars, region:us

CC-news-2024-July-October-cleaned このデータセットはCommon Crawlのnewsサブセットから作成した2024年7月から10月の日本語のニュースの文章が収録されています。データセットの規模はllm-jp/llm-jp-13b-v1.0 tokenizer使用で612M tokensです。使用したツールはUzushioです。フィルター設定はサンプルのpipeline_03a.confです。作成につきまして以下を参考にさせていただきました。 uzushio使ってwebコンテンツから綺麗な日本語コーパスを抽出する手順

View on Hugging FaceReport an issue

Author / organization	kajuma
License (as declared)	odc-by
Downloads	312 (as reported by Hugging Face)
Likes	15
Created	17 November 2024
Last updated at source	17 November 2024

Embed this entry

<iframe src="https://silytics.si/embed/item/8a5c256d-b003-4c44-8775-eebe6e1fb62d" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 4 days

312 now (+9 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

Connected in the knowledge graph

pokutuna/llm2024-competitionModel · used to train

Explore this entry in the graph

More from kajuma

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 19 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.