DongfuJiang/5M_corpus

5M Offline Web Corpus Ready-to-serve offline search corpus for WebExplorer-style agentic QA. with_gold/: 5M WebMix plus QA gold support documents. no_gold/: same corpus with gold_support documents removed. Dense retrieval: Qwen3 embeddings + USearch. Lexical retrieval: Tantivy BM25. Docstore: SQLite. For with_gold, reassemble SQLite after download: cat with_gold/offline_corpus.sqlite.parts/part-* > with_gold/offline_corpus.sqlite

<iframe src="https://silytics.si/embed/item/d9ec7161-dc3e-4f84-99c1-7a049a0ba519" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.