acceptodds
Under review as a conference paper at ICLR 2027

Can Control Learning with Bandit Optimization Accelerate Convergence in Multimodal Fusion of Medical Data?

Abstract

Multimodal fusion has become a central paradigm in medical AI, integrating heterogeneous sources such as imaging and multi-omics for diverse downstream tasks. However, its training-time efficiency remains underexplored. As training progresses, modalities and tasks contribute unevenly to learning, yet prior methods often optimize the shared multi-task loss using fixed or heuristic open-loop weighting. This mismatch limits adaptation to evolving learning dynamics and can delay convergence to strong validation performance. To address this challenge, we propose Bandit with Control-Learning Aware optimizatioN (BCLAN), a novel parameter-free hybrid closed-loop controller that augments standard optimizers without architectural changes or additional trainable backbone parameters. Driven by validation feedback, BCLAN couples adversarial bandit exploration over a compact set of loss-weight templates with proportional–integral–derivative (PID)-based refinement in logit space, enabling it to search for improved task– modality allocations while stabilizing their adaptation under noisy, non-stationary feedback. We provide theoretical insights into this coupling, establishing bounded loss-weight refinement and identifying conditions for faster convergence. Across twelve heterogeneous-modality benchmarks in the medical domain, BCLAN improves downstream performance by up to ≈ 2.7% and reduces training time by up to ≈ 50.4% compared with the corresponding baselines, achieving a favorable training-time efficiency–performance trade-off.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.