- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes Residual-Informed Sparse Decoding (RISD), a supervised feature-selection framework that combines wavelet conditional mutual information (WCMI) with out-of-fold residual-guided feature completion. RISD first selects an information core using WCMI and then adds features correlated with the current decoder's prediction residuals.
Experiments on marmoset retinal recordings, the mouse visual pathway, and macaque visual cortex show modest decoding improvements over baselines. The authors further use RISD to investigate combinatorial neural coding, functional substitution, and task- and population-dependent neural representations.
Critical strengths
1. Interpretable neural feature selection.
RISD preserves the correspondence between selected features and their original neurons, temporal windows, and scales. This enables interpretable analyses of neural population activity without relying on mixed latent representations.
2. Evaluation across multiple neural systems.
The experiments cover three species, multiple visual processing stages, and different decoding objectives.
Critical weaknesses
The main weaknesses are stated below, and the authors can check the Questions For Authors part for the details.
1. Limited methodological novelty and insufficient comparisons.
The paper mainly combines established WCMI and residual-based feature-selection techniques, as the 1st contribution stated in the last part of introduction, but the improvement on RISD compared with WCMI is incremental.
Residual-based feature-selection methods are not new. The paper neither sufficiently establishes the necessity of its two-stage design, nor compares with enough modern baselines. Without these comparisons, it remains unclear whether RISD provides a meaningful advantage over existing supervised feature-selection techniques.
2. Insufficient evidence supporting the claimed neuroscience contributions.
The 2nd and 3rd contributions stated are the neuroscience contributions, however, most analyses in Figures 2–4, including combinatorial coding, neuron deletion, functional substitution, task-dependent representations, and population-context effects, can also be performed using existing methods such as WCMI. However, the paper does not systematically compare the neuroscientific findings obtained by different approaches, making it unclear what is special on RISD compared with other methods, if different methods are all available on those tasks with minor differences ?
Overall, the experiments demonstrate that RISD can support interpretable neural representation analysis, but do not convincingly establish that it identifies more reliable or distinctive neuroscientific findings than existing approaches. This is particularly important given that the central contributions are framed as moving from information to conditional contribution.
Questions for authors
Major:
- Baselines and ablations. How does RISD compare with (i) iterative residual-only selection, (ii) in-sample vs. OOF residual selection, and (iii) other interpretable supervised feature-selection methods such as L1/Elastic Net, LassoNet, GradEnFS, or standard forward selection? Please compare under matched feature budgets and a common decoder, including accuracy–sparsity–computation trade-offs. How do RISD-selected neurons and temporal coordinates differ from those identified by conventional stimulus-tuning or single-neuron encoding analyses? Does RISD reveal reliable conditional decoding contributions that cannot be explained by individual response selectivity?
- Distinctive neuroscience contributions. Can the authors repeat the key analyses in Figures 2–4 using WCMI or other interpretable baselines? Do these methods identify similar combinatorial responses, functional substitutions, and task-dependent representations? What neuroscientific findings can RISD identify more reliably than existing methods? A same-size WCMI continuation would help distinguish the benefit of residual completion from simply adding more features. Specifically, for Figure 3C, the comparison between and uses different numbers of features. Moreover, the 23 repaired images represent a selected subset. Please report the total number of evaluated images and the full distribution of per-image accuracy changes, including unchanged and degraded cases.
- Statistical validation and stability. Can the authors provide confidence intervals and paired significance tests for Tables 1–2 and Figures 2–4 for neuroscience analysis? How stable are the selected neuron-time-scale features across independent splits or repeats? In particular, does the task-specific separation in Figure 4E–F exceed same-task selection variability and appropriate null baselines?
- Interpretation of neuroscience results. How are the information gains in Figure 2D and the evidence scores in Figure 4F defined? Do the reported joint gains establish genuine information synergy or simply complementary decoding information? Can the authors provide appropriate controls for neural response correlations and population size, particularly for Figures 2 and 4G?
- Feature-selection fairness and computational cost. The WCMI baseline uses the feature budget selected by RISD. How does WCMI perform with its own optimized feature budget? Can the authors provide accuracy-versus-feature-count curves and runtime comparisons, including WCMI ranking, cross-fitting, and residual scoring?
- Cross-fitting and potential leakage. Is WCMI feature ranking and K_1 selection repeated independently within each inner fold? Otherwise, OOF residuals may be affected by supervised feature selection using held-out labels. Please clarify the complete nested validation procedure.
Minor:
- Experimental protocol and reproducibility. What are the numbers of animals, sessions, trials, classes, and outer folds? How is StimID voting accuracy defined? Please clarify the differences between the results in Table 1, Table 2, and Figure 3B. What are the exact decoder architecture, training settings, and search ranges and selected values for K_1, K_2, and P? Are wavelet coefficients standardized before covariance-based scoring? Given the absence of a methodological appendix, could the authors provide a detailed appendix or supplement specifying the missing experimental and implementation details, together with anonymized code or complete reproduction configurations?
The reviewer would update the score if reasonable answers are provided.