- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2(+1)
- Soundness
- 2
Read review
Paper summary
This paper addresses multi-dimensional robustness in multimodal learning. The classic baseline, Group DRO, forms the Cartesian product of all dimensions into a single grouping structure, but as the number of dimensions grows, this causes a combinatorial explosion with too few samples per group. The paper proposes Dimension-wise DRO: each dimension first performs a Group-DRO-like weighting on its own, reducing the losses of its groups to a single value; these per-dimension values are then aggregated into one total loss via Hedge-style adaptive weighting, with theoretical guarantees on the worst-case risk bound and convergence rate. Experiments on three multimodal benchmarks show consistent improvement in worst-group performance.
Critical strengths
The paper identifies the combinatorial group-explosion problem that arises when Group DRO is applied to multiple independent dimensions and proposes a dimension-wise formulation with a theoretical worst-case risk guarantee.
Critical weaknesses
- The paper's two-layer aggregation uses two different schemes: worst-case within each dimension, but a standard weighted sum across dimensions. The latter is, mathematically, the same problem as multi-task loss weighting (e.g., GradNorm, uncertainty weighting), yet the paper never discusses this connection or explains why the two layers use different aggregation schemes.
- Table 6 shows that a baseline trained on the best single dimension already reaches a worst-group accuracy of 24.9, while the full method reaches 28.4, a gap of only 3.5 pp, far smaller than this baseline's gap over the Cartesian-product baseline (24.9 vs. 14.1). The paper's core mechanism yields limited gains.
Questions for authors
None
Thank you for the clarifications. The relation to multi-task loss weighting and the distinction between the inner and outer layers are now clear, and I have raised my presentation score. My main reservation remains, however: the improvement in Table 6 is modest relative to the extra complexity, so I will keep my overall score.