jina-embeddings-v5-text: Task-Targeted Embedding Distillation
Text embedding models are widely used for semantic similarity tasks, including information retrieval, clustering, and classification. General-purpose models are typically trained with single- or multi-stage processes using contrastive loss functions. We introduce a novel training regimen that combines model distillation techniques with task-specific contrastive loss to produce compact, high-performance embedding models. Our findings suggest that this approach is more effective for training small models than purely contrastive or distillation-based training paradigms alone. Benchmark scores for the resulting models, jina-embeddings-v5-text-small and jina-embeddings-v5-text-nano, exceed or ...
| Authors | Mohammad Kalim Akram, Saba Sturua, Nastia Havriushenko et al. |
|---|---|
| Primary category | cs.CL |
| Published | 17 February 2026 |
| Last updated at source | 28 April 2026 |
Models and datasets referencing this paper
- jinaai/jina-embeddings-v5-text-nanoModel
- jinaai/jina-embeddings-v5-text-smallModel
- jinaai/jina-embeddings-v5-text-small-text-matchingModel
- jinaai/jina-embeddings-v5-text-nano-retrievalModel
- jinaai/jina-embeddings-v5-text-small-retrievalModel
- jinaai/jina-embeddings-v5-text-nano-classificationModel
- jinaai/jina-embeddings-v5-text-nano-retrieval-GGUFModel
- jinaai/jina-embeddings-v5-text-small-classificationModel
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.