- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
DS-LCCA adapts visual supervision for EEG/MEG decoding by processing lightness and chromatic coordinates separately in CIELUV space. Three independently parameterized Residual Projection Encoders align neural recordings with frozen CLIP RN50 features of the original and two transformed images. Retrieval and classification use the union of the three branch-specific top-k sets. A separate ATM–ViT-H-14 alignment branch supplies the primary reconstruction condition through a diffusion prior, while generation-trained affine projections of the lightness/chromatic embeddings supply auxiliary conditions to SDXL through separate IP-Adapters. Experiments cover THINGS-EEG and THINGS-MEG, within- and held-out-subject discrimination, reconstruction, component/operator ablations, encoder assignments, and temporal/spatial/spectral analyses. The principal contribution claimed is the value of component-specific visual supervision rather than a new contrastive objective or foundation model.
Critical strengths
-
Thie paper propose a coherent, task-motivated supervision design with an explicit inference pathway. Separately modifying lightness structure and chromatic variation is an intelligible alternative to treating the original image representation as the only alignment target. The manuscript defines the transformations, independent alignment losses, diffusion prior, and auxiliary generation projections explicitly. In particular, the reconstruction formulation specifies a gradient pathway from the generation objective to the auxiliary projections, rather than assuming that an arbitrary projection automatically supplies useful conditioning. This makes the proposal a testable methodological hypothesis.
-
Empirical coverage extends beyond a single aggregate score. The study includes EEG and MEG, subject-wise retrieval tables, multiple classification candidate-set sizes, reconstruction metrics, and qualitative examples. The chromatic-operator comparisons and the four primary–auxiliary encoder assignments are useful existing controls, and the appendices provide substantial parameter and input-window analyses. The paper also explicitly discloses that its discrimination output is a union containing up to 3k candidates and that Figure 6 does not define an ordering of that union. This transparency should be credited, even though it does not resolve comparability with the baseline rows.
Critical weaknesses
-
Unfair Top-k Evaluation Protocol. The proposed union-based retrieval metric returns up to 3k candidates, making its reported Top-1/Top-5 results not directly comparable to conventional Top-k baselines. A fair comparison using identical candidate budgets and a single ranked prediction is necessary.
-
Inconsistencies in Reported Results. Several numerical discrepancies appear across tables, particularly in the MEG results (Tables 1 and 6), subject-level averages (Table 5), and reconstruction metrics. These inconsistencies undermine the reliability of the experimental conclusions and require clarification.
-
Insufficient Validation of the Core Contributions. The experiments do not adequately isolate the benefits of lightness/chromaticity decomposition from generic multi-branch ensembling or increased model capacity. Critical controls, including original-image-only baselines and capacity-matched ensembles, are missing.
-
Limited Justification of Component-Specific Processing. The lightness and chromaticity transformations do not guarantee perceptual disentanglement, as the resulting images retain information from other components. The effectiveness of the proposed transformations and wavelet decomposition requires stronger quantitative and theoretical justification.
Questions for authors
-
Which rows in Tables 1 and 5–7 are ordinary ranked Top-k accuracy, and which use Eq. (11)? Were the baseline rows evaluated with the identical union rule? For the same checkpoints, please report R/L/C separately, mean union size and overlap, and a label-free single-ranking fusion at exactly Top-1 and Top-5. Explain the source of the Figure 6 rankings. Union coverage may remain as a separately named, cardinality-matched measure.
-
How should the MEG subject-wise mean of 41.125%/71.50%, the Table 6 average of 34.3%/63.9%, and the Table 1 result of 31.28%/60.46% be reconciled? Please identify the exact subjects, checkpoints, scoring rules, and averaging steps. Also clarify the Table 5 baseline averages, the Table 9 classification aggregation, and the 0.5294 versus 0.5249 SwAV values. Paired-ID prediction/score outputs would resolve these issues directly.
-
Are quantitative R-only and matched three-original-view discrimination controls available? Is R retained in the Table 1 single-component rows? For generation, please provide or locate a matched G-only result and an original-image-only multi-condition control, with the same trainable capacity and sampling settings.
-
Please specify the RGB conversion and gamut policy, image resolution, wavelet boundary handling, and treatment of signed/near-zero lightness in detail-only images. What measured lightness and chromaticity changes remain after conversion back to RGB? How do those measurements support the intended interpretation given the L-dependent relationship between u*, v* and u', v' in Eq. (3)?
-
Which validation split and selection policy determined checkpoints and all reported defaults? Please identify the concept/subject split manifests, independent runs, and paired uncertainty outputs. For reconstruction, provide the stage-specific freeze/train schedule, condition/prompt specification, sampler and seed manifest, number and selection of generated outputs, and exact metric/aggregation functions. Pointing to the corresponding files in the linked repository is sufficient where these details already exist. These requests concern the reported tasks and datasets, not a new application domain.