ClinFusion: A Vision-Centric Multimodal LLM System for Holistic Medical Understanding
Multimodal large language models (MLLMs) hold immense potential to revolutionize clinical practice, yet deploying them in the medical domain is fundamentally a vision-centric challenge: models must absorb knowledge from heterogeneous 2D and 3D medical images, and evaluation protocols must align with radiologists' clinical practice and provide an accurate, fine-grained and factualness-driven assessment. In this paper, we introduce ClinFusion, a vision-centric MLLM designed for holistic medical understanding that systematically addresses these limitations. We propose a compositional and cascaded vision encoder architecture featuring a Cascade Spatial-Aware Locality Fusion operator that unif...
| Authors | Hangjie Yuan, Yichen Qian, Zhiwei Tang et al. |
|---|---|
| Primary category | cs.CV |
| Published | 27 July 2026 |
| Last updated at source | 28 July 2026 |
Connected in the knowledge graph
- Alibaba-DAMO-Academy/ClinFusion-Eval-DataDataset · cited by
- Alibaba-DAMO-Academy/ClinFusion-8BModel · cited by
Models and datasets referencing this paper
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.