- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper introduces HiLa to leverage multiple levels of behavior labels to guide representation learning in sequential decoding tasks with MEG, with improved performance over baselines on two sequential decoding dataset. HiLa showed generalization performance to held-out data while finetuning only the participant specific parameters, and analysis on gradient showed biologically plausible pattern.
Critical strengths
- Propose to learn on multiple level of behavior labels in the sequential tasks
- Show improved performance on two datasets
- Detailed experiments on ablation study and representation analysis
Critical weaknesses
- The method’s usability is limited: for sequential task, online setting is not evaluated and long context is not leveraged; the labels used is constrained to sequential tasks hence unlikely to be generic
- I find the model architecture very complicated and seems arbitrary (multiple mixer and multi-scale convolution with 5 specific k values)
- Latent disentanglement is manually forced rather than emerged
- Code is not provided
Questions for authors
- Regarding the tasks, can the author elaborate on why the position would help the performance especially when window size is small? Is there only one or multiple words or finger press in each window?
- Are there statistical test results in Table 2? What are the results of [y][c] and [y][e]?
- Please separate methods and related works, right now it is highly mixed
- Can the authors describe roughly the roles of each of those multiple mixer and multi-scale convolution. Are the choices of the 5 K empirically or theoretically?
- Why frame the motivation as generic non-invasive recording (as shown in title, abstract and introduction) while actually running on MEG? Is the method adoptable to EEG / FMRI?
- For cross-subject / cross-sentence experiment, could the author provide curve when trained from scratch and finetuning with competitive baselines
- In ablation study (Figure 3) what are the values for each variant, the first 3 or 4 variants looks similar.
- Why there are no recent EEG foundation models baselines in Table 1 (Labram or REVE) which can be more competitive?
Dear Reviewers,
Please take a moment to review the authors’ rebuttal, assess whether your concerns have been adequately addressed, and actively participate in the discussion. Please update your assessment if needed. Thank you for your time and effort!