- Rating
- 4
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes SpaRTran, a self-supervised pretraining framework via sparse recovery from a compressed sensing task. The idea is very novel and interesting, where the task can help the model learn about the signal structure compared to conventional general pre-training methods like the MASK. By fine-tuning on different tasks (including classification and regression tasks), the method shows superior performance.
Critical strengths
-
The compressed sensing-based pre-training method is very novel and efficient.
-
The proposed pre-training method shows good performance compared to a series of pre-training solutions.
Critical weaknesses
-
The main concern is that the comparison to task-specific methods is missing. If they already have good performance, the introduction of such a pre-training model will have limited meaning.
-
The training costs (e.g., iterations, GPU cost) are missing.
Questions for authors
Please consider responding to the weakness part, whether from empirical results or word explanation. Overall, I believe this paper has good quality. If my concerns are addressed, I would like to increase the score to 4.
4 comments
Thank you for your efforts to address my concerns. Regarding Weakness 1, I still have some concerns. First, WiT was originally designed for localization rather than beamforming; therefore, more relevant beamforming methods should be compared. Moreover, WiT is somewhat dated. Although I do not think these issues diminish the value of the work itself, in its current form I would like to maintain my previous score.
Thank you for your fast answer. We believe we can resolve your remaining concerns as well.
We would like to note that the benefits of pretraining for localization and beamforming tasks are well established in the literature (e.g. Guler2025, Alikhani2024). Therefore, to maintain a clear focus on our core contributions and adhere to the page limit, we did not conduct an additional evaluation of these benefits.
We would also like to emphasize that, in line with existing work on self-supervised learning, our goal is not to establish a universally superior method across all downstream tasks, but rather to demonstrate the effectiveness of our proposed self-supervised pretraining objective. The downstream tasks serve as evaluation benchmarks to assess the quality of the learned representations. The observed performance improvements under the evaluated conditions provide evidence that our pretraining procedure learns representations that are beneficial for downstream applications.
Nonetheless, we agree that a comparison against a supervised baseline is interesting, which is why we included WiT. We interpret WiT primarily as an application of the Transformer architecture to CSI signals rather than as a method restricted to positioning tasks. We therefore selected WiT as a suitable supervised baseline due to its Transformer-based architecture. From a methodological perspective, the two downstream tasks share a similar learning setup, with the main difference lying in their respective learning objectives.
We are not aware of a more recent purely-supervised approach that would provide a better candidate for comparison.
Thank you again for your thoughtful review. We hope these clarifications address your concerns. If any questions remain, we would greatly appreciate it if you could elaborate on the specific evaluation you would like to see.
Thank you for your further explanation. I find this clarification convincing, and I have increased my score to 4.
Thank you for your review.
About the weaknesses:
We added a corresponding section in the appendix of the paper (see Section A7).
Thank you again for giving us a positive rating. We hope we could address your concerns adequately and would greatly appreciate if you could raise your score accordingly.