- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper argues that fixed weighting of task- and modality-specific losses delays convergence in multimodal medical models. It proposes BCLAN, a plug-in controller that reweights losses at each validation interval: an EXP3-IX bandit samples a weight template from a small fixed pool, and a PID controller adds a bounded logit-space bias driven by validation feedback. Theorem 1 bounds the weight deviation and expected time to reach a validation-loss threshold; Corollary 1 gives a condition for faster convergence than static weighting. On 12 datasets with seven host models and four online adaptive baselines, the paper reports up to 2.7-point gains and 30–50% lower per-epoch training time for the two-head, supported by ablations and sweeps.
Critical strengths
- Relevant problem and lightweight plug-in design. The paper moves the efficiency question in multimodal medical fusion from architecture to loss allocation during training, and BCLAN wraps existing pipelines without architectural changes or additional trainable parameters, adding about 1.4% controller overhead per epoch.
Critical weaknesses
-
The central claim of faster convergence is untested, and the evaluated controller is not the analysed one. The paper defines its objective as the expected time to reach a validation-loss threshold (Eqs. 4–5) but never reports this time, or the threshold, for any method; it reports per-epoch training time (#TTE) instead. Loss reweighting leaves per-epoch computation unchanged and the controller adds overhead (Table 16), so the 30–50% #TTE reductions lack a mechanism.
-
The reported gains cannot be attributed to closed-loop control. All competing methods are sampling, learning-rate, or calibration schemes rather than loss-weighting methods; adaptive weighting baselines (e.g., uncertainty weighting, GradNorm), a validation-selected static weight, and random template switching are missing.
Questions for authors
-
How is #TTE measured, and how does loss reweighting reduce per-epoch time by 30–50% when architecture, FLOPs, data, and batch size stay unchanged? Did training use early stopping? Please report the paper’s own objective—epochs and wall-clock time to a pre-specified threshold J*—for every method and seed, and state J* for each dataset.
-
Which controller produced Tables 1–4: the loss-based version of §2.3, the accuracy-based version of App. E (A = 5)? Table 15 reproduces the main result at A = 8. Please reconcile these settings and report results for the loss-based controller that Theorem 1 covers.
-
Table 2 repeats identical standard deviations across different methods (e.g., ±7.38/±2.38/±3.43 for four DRIFA-Net rows; MAIL+ADAMBS and MAIL+Incremental PID share all three values). How were these computed? Please provide per-seed or per-split results for Tables 1–3, standard deviations for Table 1, and paired differences with confidence intervals or paired tests.
-
How was the “oracle fixed” template in Table 15 selected (validation or test)? Please add a validation-selected static weight, uniform random template switching without bandit updates, adaptive weighting methods (uncertainty weighting, GradNorm, DWA, FAMO), and multimodal balancing methods (e.g., OGM-GE, AGM, MMPareto). The current competitors address sampling, learning-rate scheduling, or calibration, not loss weighting.
-
Please plot λ, b, and arm probabilities over training. Because b accumulates the full PID output (Eqs. 15, 47), the gains act on b as Kd·ε+Kp·Σε+Ki·ΣΣε, and B=2 permits a ±4 shift in the log-weight ratio, whereas the templates span only ±1.39. Does b saturate? What is d in §2.3? Does the bandit favour better templates when its reward mainly tracks training progress?
-
HAM10000 accuracy of 99.4–99.6% and MIMIC-III mortality AUC up to 95.9% exceed values commonly reported for these benchmarks. Are splits lesion- and patient-level (HAM10000 contains several images per lesion)? The released code subsamples the test set (810 of 1001), splits SIPaKMeD 64/16/20 rather than the stated 80/10/10, and keeps dropout active at test time; please clarify.
-
Fig. 5 sweeps a “reward scale” that appears in no equation and cannot apply to Incremental PID or PID-AGD; Table 16 uses an undefined T̂*_R. Please define or remove these, report sensitivity to Kp, Ki, Kd, B, λ_b, the target, and the template values, and justify “parameter-free”.
-
Evaluate BCLAN on genuinely paired multimodal data with more than two loss components, and specify how to construct templates when T·m > 2.