- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper studies whether a learned spatial gate can be taught where to trust one modality over another.
The question is instantiated in CLOAK, a camouflaged object detector that fuses two frozen modalities: SAM 2.1 semantics and Depth Anything V2 geometry. The gate is supervised by the detached pixelwise loss difference between two auxiliary segmentation probes. This signal is derived as the exact minimizer of an entropy-regularized two-source risk.
Experimental results show the detector itself is strong under a matched protocol, yet its gate fails to identify trustworthy geometry, performing even worse than the trivial constant rule “always trust geometry”. The authors attribute this to margin collapse: since both probes are accurate, ~80% of pixels have loss margins below 0.05 and receive near-constant targets at 0.5, leaving the gate little signal to learn from. They conclude that margin-based relative-competence supervision degenerates as its experts co-improve, a limitation they position as general to loss-difference routing.
Critical strengths
++ Using probes to diagnose when the gate works and when it fails is an interesting idea.
++ The paper provides extensive hyperparameter details, even listing the exact random seed numbers—something rarely seen in previous papers.
Critical weaknesses
-- The paper’s diagnosis is based on a single gating design, a single architecture, and a single task, yet it concludes that margin collapse is “a general obstacle for loss-difference routing, not an artifact of one architecture”. To support the generality claim, additional gating mechanisms and tasks should be analyzed.
-- Both branches come from the same RGB image—monocular depth is estimated from it too—so the two experts share the same information ceiling: as both probes improve, their errors shrink together and the margin collapses almost by construction. The observed failure may thus be a property of same-source fusion, not loss-difference routing in general. With genuinely different inputs (e.g., RGB plus sensor depth or thermal), one expert can be right where the other is wrong, so margins can stay wide even when both are accurate. The authors should test such a setting to see whether collapse still occurs.
-- The gate is supervised by targets derived from probe loss differences, not by the final task loss alone. A gate trained end-to-end from the task loss could learn a different routing mechanism from one shaped by this proxy supervision, so conclusions drawn under probe supervision may not transfer to the setting the paper claims to generalize to. A simple ablation—removing the probe supervision and letting the gate learn from the task loss—would settle this, but it is absent.
-- The paper suggests fixes for gate unreliability, but none is ever tested. Validation stops at discussion, with no experiment showing that any remedy actually prevents margin collapse or restores routing.
-- The paper frames its contribution as learning when to trust geometry, yet the proposed gate never actually learns a reliable “when”: it collapses to over- or under-trusting, its confidence tracks neither depth correctness nor causal benefit, and no working mechanism is ultimately delivered. What remains is a diagnosis of failure, not a solution to the stated problem—so the central claim of the title overstates the contribution.
-- The method is illustrated only by a simple text-block diagram (Fig. 1). The main text contains no visualizations of gate maps, margin distribution, or corruption responses. In addition, a stray vertical black edge remains along the left side of Fig. 1, suggesting a screenshot was pasted without cropping.
-- Every appendix reference renders as “??” (L067, L143, L198, L209, L358, L417, L450, L453), and in-text table references are similarly broken (e.g., L267–269, L415).
Questions for authors
N/A