- Rating
- 2
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies conditional dependence shift (CDS), where the clean-content distribution and each modality’s conditional quality marginal remain unchanged, while the dependence among modality quality states varies. The authors characterize coupling-invariant losses through additivity, derive a risk decomposition, and introduce a coupling-sensitivity modulus computable by linear programming. Based on this analysis, StableFuse combines modality-local evidence aggregation, coupling-based training, and quality interaction regularization (QIR). Experiments on four multimodal benchmarks report improvements in average and conditional worst-case performance. The problem is meaningful, but inconsistencies in the reported results and limitations in the empirical validation need to be addressed.
Critical strengths
- The paper identifies a meaningful robustness setting that separates changes in cross-modal quality dependence from changes in individual modality quality. The within-sample coupling construction provides a controlled way to investigate this failure mode. 2.The theoretical analysis establishes a clear connection between nonadditive quality effects and coupling sensitivity. Under the stated finite-state and full-support assumptions, the main proofs appear sound. The computable modulus also provides a quantitative diagnostic beyond reporting classification performance alone.
- The proposed regularizer directly targets the interaction residual identified by the theory. Evaluation across four benchmarks and five random seeds, together with component ablations and alternative corruption operators, provides a useful starting point for assessing the approach.
Critical weaknesses
1.The empirical evaluation covers a narrower coupling class than the theoretical analysis. For three modalities, permutation-based couplings do not generally characterize all fixed-marginal distributions; the scope of the worst-case claims should therefore be qualified. 2.The connection between certificate reduction and classification robustness remains insufficiently established. Since logit rescaling can reduce cross-entropy sensitivity without changing predictions, calibration-controlled comparisons and decision-level stability metrics are needed. 3.The experimental evidence does not fully isolate the contribution of QIR or establish robustness beyond the prescribed corruption setting. Matched training conditions, full-model-minus-QIR ablations, and varied corruption configurations are necessary to substantiate these claims. 4.If Conditional Range denotes the sample-averaged coupling loss range for the same checkpoints and loss normalization, Theorem 3 and Table 3 imply an upper bound of 0.182 on CREMA-D. The larger value in Figure 3 therefore requires clarification. 5.The consistency of the experimental reporting is unclear. Tables 1 and 5–6 report substantially different PH results despite describing the same evaluation protocol, making the reported improvements difficult to assess reliably. 6.The implementation description is insufficient for independent reproduction. Backbone configurations, training schedules, benchmark-specific hyperparameters, and the precise reliability-ranking objective should be explicitly specified.
Questions for authors
1.For the three-modality benchmarks, how much does the worst expected loss increase when optimizing over all fixed-marginal couplings rather than only permutation couplings? 2. Does the reduction in the certified modulus persist after controlling for logit scale or temperature? Does QIR also reduce coupling-induced prediction changes and classification-error variation? 3.Can the authors report full-model-minus-QIR results, matched corruption-training baselines across all benchmarks, and experiments with different numbers of temporal bins and corruption durations? 4.How is Conditional Range in Figure 3 computed? Does it use the same loss normalization, checkpoints, and samples as Table 3? Can the authors provide a per-sample verification of the bound in Theorem 3? 5.What explains the differences between Table 1 and the PH rows in Tables 5 and 6? Please specify any changes in training or evaluation settings.