- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This work proposes Pre2Inf, a deep unfolding classifier that feeds intermediate class predictions back into later sparse coefficient updates. It uses confidence-weighted predictions to adjust atom-wise regularization, improving results on eight hyperspectral datasets and providing smaller gains on CIFAR-10/100.
Critical strengths
1 Predictions directly change the regularization in the next coefficient solve, giving the method a concrete interpretation beyond simply adding another prediction head. Combining semantic feedback with reconstruction similarity is also a sensible way to retain information from the input.
2 This paper compares open-loop, naive, delayed, and confidence-aware feedback, alongside component removal studies. The full model improves over the open-loop version across the four analyzed hyperspectral datasets, and the CIFAR experiments offer some evidence that the idea extends beyond hyperspectral classification.
Critical weaknesses
1 The experiments use a fixed seed without reporting variation across training runs or sampled splits. Random pixel splits also leave the possibility of overlapping train/test neighborhoods unaddressed. This matters especially for the small CIFAR gains of 0.47 and 0.61 percentage points.
2 Entropy-based gating reduces uncertain feedback, but a confidently wrong prediction can still steer inference toward the wrong class. The naive variant’s sharp accuracy drop on one dataset highlights this risk. The theoretical analysis bounds individual coefficient updates, while convergence of the full loop assumes a contraction condition that is not established for the trained network.
Questions for authors
1 Could you please report results across multiple seeds and spatially separated hyperspectral splits, with validation data used explicitly for hyperparameter selection?
2 How does the full model behave when intermediate predictions are confidently wrong? A controlled feedback-corruption test would help show whether later stages correct or reinforce these errors.
3 Table 3 shows substantial closed-loop gains already at Stage 1, although feedback is initially disabled. Could you separate benefits learned during training from the effect of feedback during inference—for example, by disabling feedback in a trained model?
4 What are the parameter count, inference latency, and memory cost relative to the open-loop model and representative unfolding baselines? How does the coefficient solve scale as the number of classes and dictionary atoms increases?