SEA-LION-Embedding: Open and Reproducible Text Embeddings for Southeast Asia
Text embeddings are fundamental to many downstream applications, making robustness important for real-world NLP. However, most recent state-of-the-art embedding models are not reproducible because they rely on closed or undisclosed training data, and they remain insufficiently robust for Southeast Asian languages. We present SEA-LION-Embedding, a fully open and reproducible text-embedding pipeline for Southeast Asian languages trained only on publicly available data, and use it to study three core factors of robust embedding design: data composition, training objective, and base encoder initialization. SEA-LION-Embedding achieves state-of-the-art results on SEA-BED while enabling systemat...
| Authors | Peerat Limkonchotiwat, Raymond Ng, Sarana Nutanong et al. |
|---|---|
| Primary category | cs.CL |
| Published | 2 June 2026 |
| Last updated at source | 9 September 2026 |
Connected in the knowledge graph
- aisingapore/SEA-LION-E5-Embedding-600MModel · cited by
- aisingapore/SEA-LION-ModernBERT-Embedding-300MModel · cited by
- aisingapore/SEA-LION-ModernBERT-Embedding-600MModel · cited by
Models and datasets referencing this paper
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.