stai-tuebingen/faiss-smollm
FAISS-Based Novelty Detection for SmolLM and SmolLM2 This tutorial demonstrates how to the measure novelty of text queries with respect to the provided SmolLM and SmolLM2 pretraining corpora, with optional ColBERTv2 re-ranking for improved precision. Overview The pipeline consists of four main steps: Generate Embeddings - Encode your queries using a sentence transformer FAISS Search - Retrieve top-K most similar documents from the pretraining corpus Combine… See the full description on the dataset page: https://huggingface.co/datasets/stai-tuebingen/faiss-smollm.
| Author / organization | stai-tuebingen |
|---|---|
| License (as declared) | odc-by |
| Downloads | 29.9K (as reported by Hugging Face) |
| Likes | 0 |
| Created | 21 October 2025 |
| Last updated at source | 1 January 2026 |
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 14 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.