Dataset · Hugging Face

nakasyou/awesome-japanese-corpus

Name: awesome-japanese-corpus
Creator: nakasyou
License: odc-by
Keywords: task_categories:text-generation, language:ja, license:odc-by, license:cc-by-4.0, size_categories:100M<n<1B, format:parquet, modality:text, library:datasets, library:dask, library:polars, library:mlcroissant, region:us

Awesome Japanese Corpus 4つの日本語データソースを text、from、from_license の3列に正規化した Parquet データセットです。 FineWeb以外の3ソースは、生成処理を停止した時点までに取得済みの公開データを採用しています。FineWebは最大3シャードを並列先読みする1時間限定の処理でサンプリングしています。空文字は除外しています。Infini-News は取得済みの年度について language_iso639_3 == "jpn" の行を採用しています。 Sources hotchpotch/fineweb-2-edu-japanese (odc-by) ruggsea/infini-news-corpus の language_iso639_3 == "jpn" (cc-by-4.0) turing-motors/MOMIJI (cc-by-4.0) AhmedSSabir/Japanese-wiki-dump-sentence-dataset… See the full description on the dataset page: https://huggingface.co/datasets/nakasyou/awesome-japanese-corpus.

View on Hugging FaceReport an issue

Author / organization	nakasyou
License (as declared)	odc-by
Downloads	645 (as reported by Hugging Face)
Likes	1
Created	29 July 2026
Last updated at source	30 July 2026

Embed this entry

<iframe src="https://silytics.si/embed/item/4ee9f5e9-53c0-44f1-9a29-7600217545db" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

645 now (-52 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

More from nakasyou

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.