- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies WiFi-language representation learning and cross-modal retrieval in a WiFi sensing setting. The proposed SignalLang framework combines a WiFi encoder operating on subcarrier–time patches with contrastive, matching, language-modeling, and auxiliary activity-classification objectives. It also introduces motion-focused caption supervision and class-aware negative masking. SignalLang supports caption generation, bidirectional retrieval, and WiFi question answering. Experiments show substantial improvements over an amplitude-only WiFi2Cap adaptation on seen XRF55 activities.
Critical strengths
-
The study is well motivated to align WiFi signals with language descriptions.
-
The supervision and language description generated are sensor-aware. The paper identifies an important mismatch between video-derived descriptions and information supported by WiFi CSI. Its motion-focused supervision aims to retain motion semantics while excluding unsupported visual details. This is a useful principle for transferring supervision between sensors with different observation capabilities.
-
The proposed method covers caption generation, retrieval, and WiQA. The study also distinguishes activity-level retrieval from instance-specific matching, its hallucination proxy from verified factual errors, and framework portability from zero-shot checkpoint generalization.
Critical weaknesses
-
The retrieval results support a learnable association between WiFi and activity semantics. However, retrieval relevance is defined by activity labels, and caption evaluation includes references from the same activity class. These protocols do not establish whether the model recovers recording-specific body-part movements, directions, repetitions, or temporal structure. The FullCap versus SimpleCap comparison is useful, but it changes both descriptive content and linguistic diversity. The evaluation of WiQA also lacks reported question-only and signal-replacement controls. Consequently, activity recognition followed by class-conditioned language generation remains a plausible explanation for a substantial part of the performance. The support for fine-grained WiFi–language understanding is limited.
-
Most training processes follow commonly used multimodal learning approaches. Subcarrier–time tokenization provides a reasonable CSI-specific adaptation, but the main ablations do not directly test this design against alternative encoders under matched conditions. They therefore do not establish whether the gains come from the proposed signal representation, additional activity supervision, or the combined training objectives.
-
Most baseline comparisons and component ablations on XRF55. XRF V2 was used mainly to demonstrate portability after training, without evaluating matched competing methods or corresponding component validation as used on XRF55.
Questions for authors
Please refer to the points listed in Critical Weaknesses.
4 comments
Author Response to Reviewer fjPF (Continued)
3. Additional Evaluation on XRF V2
We extended our XRF V2 experiments with a matched WiFi2Cap* baseline and additional ablation studies. Specifically, we evaluated the effects of auxiliary activity supervision, class-aware negative masking, and MAE initialization. The results are summarized below:
| Variant | Wi2TR R@1 | T2WiR R@1 | B@4 | METEOR | ROUGE-L | CIDEr | LLM Cls.@1 |
|---|---|---|---|---|---|---|---|
| w/o auxiliary activity loss | 42.9 | 48.7 | 42.1 | 55.4 | 64.5 | 344.9 | 37.7 |
| w/o class-aware negative masking | 39.9 | 39.4 | 42.7 | 55.9 | 64.5 | 336.7 | 37.9 |
| w/o MAE initialization | 47.8 / 44.5 | 73.8 / 74.2 | 44.8 / 42.1 | 58.7 / 59.5 | 66.4 / 64.7 | 363.7 / 329.8 | 42.4 / 36.9 |
| WiFi2Cap* | 20.6 | 44.0 | 33.3 | 48.7 | 56.4 | 205.4 | 17.6 |
| SignalLang (full) | 45.4 / 45.6 | 70.9 / 54.0 | 41.5 / 41.7 | 54.8 / 58.5 | 63.7 / 64.4 | 326.6 / 317.3 | 36.2 / 36.6 |
Note: Slash-separated values represent results from two different random seeds, reported in the same order across metrics. Rows with a single value report one experimental run.
SignalLang outperforms WiFi2Cap* across all reported retrieval and captioning metrics on XRF V2. Removing auxiliary activity supervision or class-aware negative masking reduces bidirectional retrieval performance, further supporting the effectiveness of these components on a second dataset.
In contrast, MAE initialization does not consistently improve performance on XRF V2. This suggests that the benefits of MAE pretraining depend on the dataset and training setting, rather than being essential to the proposed WiFi–text alignment framework. Overall, these results demonstrate the portability of SignalLang after retraining on a different WiFi acquisition setting, while highlighting the contributions of its activity-aware alignment components.
Thank you for the response. The new WiQA controls and XRF V2 comparisons address part of my concerns. However, the concerns about recording-specific fine-grained understanding remain. Moreover, the encoder comparisons still do not show a clear advantage of the proposed WiFi encoding design. Nonetheless, these limitations do not undermine my rating.
Thanks for your reply. The additional experiments are sufficient; the reply is very good, and my concern is addressed. I will raise the point to 3.
Author Response to Reviewer fjPF
We thank the reviewer for the constructive feedback and for recognizing the motivation and contributions of our work. We have conducted additional experiments to address the concerns.
1. Activity-Level Semantics and WiQA Controls
We acknowledge that our retrieval protocol evaluates activity-level semantic alignment rather than instance-specific matching. Recordings of the same activity in XRF55 often share similar motion patterns and semantically compatible descriptions, making exact-pair retrieval potentially ambiguous. Therefore, our current retrieval results support activity-level motion-language alignment, but do not establish discrimination among recordings of the same activity.
To assess whether WiQA predictions depend on valid CSI inputs rather than linguistic priors, we evaluated three additional settings: question-only (without CSI), shuffled-CSI (CSI from another recording), and zero-CSI (all-zero input). SignalLang achieves 72.7% overall accuracy, compared with 39.7%, 36.2%, and 43.5%, respectively.
For body-part questions, SignalLang achieves 84.4% vs. 52.8% under shuffled CSI on seen activities and 61.1% vs. 37.8% on unseen activities. On seen motion-attribute questions, accuracy reaches 69.5% vs. 28.2% under shuffled CSI. These results show that valid CSI provides substantial information beyond linguistic priors, supporting CSI-dependent activity-level motion understanding. However, they do not establish recording-specific motion discrimination, which remains an important limitation of the current evaluation.
2. Additional Ablation Studies
We conducted additional experiments to evaluate the effects of different WiFi encoders and key training components. Specifically, we evaluated a randomly initialized Transformer encoder and a 1-D ResNet encoder, alongside variants without auxiliary activity supervision or class-aware negative masking. The results are summarized below:
Note: The plain BLIP-style baseline removes both auxiliary activity supervision and class-aware negative masking.
The results show that the plain BLIP-style baseline, retaining only WTC, WTM, and LM, performs substantially worse than full SignalLang. Its seen Wi2TR/T2WiR R@1 is 39.7%/42.4%, compared with 71.5%/89.8% for full SignalLang, while multi-reference CIDEr is 114.3 versus 129.8. Together with the individual ablations in our original submission, these results support the contributions of auxiliary activity supervision and class-aware negative masking.
The 1-D ResNet also outperforms the Transformer on XRF55, potentially because its convolutional inductive bias is better suited to the limited diversity of scripted motions in this dataset. Transformer-based encoders may benefit more from larger and more diverse training datasets, which remains to be investigated. These results indicate that the WiFi–text learning framework can accommodate different encoder architectures, while its performance depends on the encoder design.