- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Layer-wise Evidence-Aware Representation Learning (LEAR) for missing-modality classification under block-local optimization. Each block constructs a detached evidence reference from observed modality-head predictions to guide confidence-weighted distillation and coverage-bounded routing while preserving inter-block gradient isolation. Evidence-Guided Inference (EGI) combines fusion and evidence scores before aggregating them across blocks. Experiments on WISDM, CREMA-D, and PAMAP2 report improvements over matched Local CE baselines, with local/global comparisons and component ablations examining the contributions of evidence-aware training and inference-time guidance.
Critical strengths
The paper addresses a relevant setting by combining missing-modality classification with block-local optimization. Its detached evidence reference uses observed modality-head predictions to guide local learning without requiring an external teacher or unavailable full-input information. The experiments cover both sensor-based activity recognition and audio-visual emotion recognition, with matched local/global controls and component ablations that provide useful comparisons of the training and inference mechanisms. On WISDM, LEAR improves over Local CE across all subject-disjoint folds and achieves performance close to its globally optimized counterpart, supporting the feasibility of the approach under gradient isolation.
Critical weaknesses
W1. The paper does not establish what evidence mismatch remains under subset-aware Local CE or how inter-block gradient isolation causes or worsens it.
W2. LEAR outperforms Local CE+EGI on CREMA-D in only one of three seeds, while actor-level bootstrapping after seed averaging does not capture training variability.
W3. CE+EGI uses separately selected checkpoints, so its reported gain over CE does not isolate inference-time guidance from model selection.
W4. Comparisons with established local-learning methods are missing, LEAR trails CoMiss on WISDM, and coverage-bounded routing adds only 0.09 percentage points beyond available-evidence KD+EGI.
W5. The combination of self-distillation, adaptive weighting, and score aggregation lacks clear novelty specific to block-local learning, with little analysis of same-block supervision or confidently incorrect evidence.
W6. Exponential subset enumeration remains untested at larger scales, WISDM update time increases by 49%, and detailed encoder/fusion architectures and absolute PAMAP2 results are missing.
Questions for authors
Q1. How is evidence mismatch defined or measured? What failures remain under subset-aware Local CE that are attributable to inter-block gradient isolation, and is this mismatch demonstrably more severe than under end-to-end training?
Q2. Why does LEAR outperform Local CE+EGI on CREMA-D in only one of three seeds (Table A7)? Please provide additional runs, paired per-seed gains, convergence analyses, and uncertainty estimates accounting for variation across training seeds and test samples.
Q3. Can EGI be evaluated on identical Local CE checkpoints without retraining or checkpoint reselection to isolate its inference-only contribution? Please also compare it with simpler weighted combinations of modality-head and fusion-head predictions.
Q4. How does Local CE differ from established locally supervised methods, and why are Forward-Forward or other block-local baselines absent? Is the routing gain consistent across datasets and seeds? Is the routing distribution differentiated through its dependence on the fusion loss, or detached when computing the weighted objective?
Q5. What does the detached evidence reference add beyond ground-truth supervision? How often are high-confidence evidence predictions incorrect, and how does this affect distillation? Please compare entropy-based weighting with unweighted distillation and alternative confidence estimates.
Q6. How does training cost scale with modality count under exhaustive subset enumeration? Can the authors evaluate larger modality sets or a practical alternative to enumeration? Please specify the encoder and fusion architectures, including layer types, dimensions, and input representations, and report complete absolute results on PAMAP2.
Q7. Could the authors revise the overview figure to ensure consistent font sizes and a more compact layout, reducing excessive whitespace and improving readability?