Sign inGet started
Dataset · Hugging Face

mahiyama/mrtydi

Mr.TyDi Japanese Retrieval (rebuilt with kNN + reranker) JMTEB の mrtydi-query / mrtydi-corpus (Mr.TyDi Japanese subset) を元に、 corpus を 1024 トークン以下の chunk に分割したうえで kNN 検索と Cross-Encoder リランカーで positive と hard negative を選び直した日本語 retrieval 学習データセット。 pairs / triplets / n-tuples の 3 形式と、Cross-Encoder の生 logit から計算した quality_score で valid 行のみを抽出した n-tuples-filtered の計 4 config を提供する。 Dense Retriever / Cross-Encoder / SPLADE などの日本語検索モデル学習および KL Divergence 蒸留に使える。 Configs… See the full description on the dataset page: https://huggingface.co/datasets/mahiyama/mrtydi.

Author / organizationmahiyama
License (as declared)cc-by-sa-4.0
Downloads278 (as reported by Hugging Face)
Likes0
Created14 May 2026
Last updated at source21 May 2026
textjapaneseretrievalembeddingmrtydiwikipediacontrastive-learninghard-negative-miningknowledge-distillationcross-encoder
Embed this entry
<iframe src="https://silytics.si/embed/item/e10945b5-52b6-4cf7-bcee-83567abcb5b8" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Connected in the knowledge graph

Explore this entry in the graph

More from mahiyama

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 20 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.