LongMoE: Longitudinal Multimodal Learning via Trajectory-Aware Mixture-of-Experts

Excerpt

arXiv:2606.09907v2 Announce Type: replace Abstract: Multimodal clinical learning is increasingly important for integrating diverse patient data, including imaging, text, and personalised health records. However, it faces two fundamental challenges: i) modality missingness, where arbitrary subsets of modalities are unavailable at a given patient visit, ii) longitudinal dynamics, where the diagnostic significance of an observation depends on the patient's evolving disease trajectory over time. Exi