Learning Sparse Latent Predictive Foundation Model for Multimodal Neuroimaging
Brain MRIs are routinely acquired as multiple complementary sequences with unique contrast weighting, including T1-weighed imaging (T1w) anatomic and fluid-sensitive T2-weighted (T2w) contrasts. However, methods for learning unified representations across the multitude of MRI contrast mechanisms at health-system scale are lacking. In this study, we introduce Neuro-JEPA, a sparse multimodal neuroimaging foundation model that combines a latent predictive objective with a Mixture-of-Experts architecture to encode brain MRI across core T1w, T2w, and fluid-suppressed FLAIR imaging (FLAIR). We further provide a systematic methodological study of architectural, masking, objective, and sparsity d...
| Authors | Haoxu Huang, Long Chen, Jingyun Chen et al. |
|---|---|
| Primary category | cs.CV |
| Published | 12 June 2026 |
| Last updated at source | 15 September 2026 |
Connected in the knowledge graph
- NYUMedML/Neuro-JEPAModel · cited by
- NYUMedML/Neuro-JEPA-LargeModel · cited by
Models and datasets referencing this paper
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.