- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper presents EM-Lens for question answering over long I/Q observations containing communication, radar, and jamming signals. It introduces the synthetic longEM-IQA training set and longEM-Bench, which cover 11 identification, parameter-estimation, and composite-entity tasks. EM-Lens combines a Mamba2 signal encoder with Qwen3.5-4B and uses an agentic runtime to localize and crop relevant intervals and optionally invoke DSP tools. The model is trained with mixed long- and short-observation supervision, shallow temporal and deep decision LoRA routers, and GRPO over tool-interaction trajectories. EM-Lens obtains an average score of 71.3 on longEM-Bench and 71.7% accuracy on the short-observation EM-Bench subset.
Critical strengths
The paper addresses an important gap between isolated signal perception and mixed-observation analysis. Moving from pre-segmented snippets to query-conditioned localization and analysis within longer I/Q observations is practically relevant. The benchmark covers identification, physical parameter estimation, and composite entities, while the appendix provides explicit scoring rules, tool interfaces, and representative DSP estimators. This task formulation is a useful step toward more complete EM reasoning systems.
The framework performs strongly on the proposed benchmark while retaining short-segment perception. EM-Lens reaches 71.3 on longEM-Bench and leads the listed methods on all 11 tasks. More importantly, the internal comparisons show that routed mixed-data training raises the long-observation average from 65.9 to 69.5 and short-observation accuracy from 62.4% to 71.8%, while GRPO further improves the long-observation score to 71.3. These results show that the model can jointly support long-observation analysis and short-segment perception within the evaluated setting.
Critical weaknesses
The observation-level generalization claim is evaluated only within one synthetic data pipeline. Both longEM-IQA and longEM-Bench come from the authors’ simulator, while the separation of waveform templates, parameter ranges, and channel conditions between training and evaluation is unclear. The paper provides no evaluation on measured captures, an independent simulator, or EMRB, which it cites as a full-length I/Q benchmark. The results therefore establish performance on the proposed synthetic distribution, but do not yet support the broader motivation of real-world receiver analysis.
The core zoom-and-measure and routed-specialization mechanisms are not cleanly isolated. Localization is central to the method but is not evaluated separately. The 33.0-to-66.8 comparison adds CoT supervision and tool interaction together, while the appendix examples use cropping followed by direct perception rather than the DSP tools. It is therefore unclear how much the localization and measurement tools contribute. Routing is also introduced as a complete package: Figure 3 provides only correlational motivation, without a parameter-matched shared LoRA baseline or separate shallow and deep router ablations. The evidence does not yet isolate the paper’s main technical contributions.
Questions for authors
- How are the training, validation, and benchmark examples separated? In particular, do they share the same waveform templates and parameter ranges? Could you also evaluate transfer to EMRB or measured data?
- Can the authors report standalone localization results and separate the effects of cropping, DSP tools, and CoT supervision? A comparison between predicted and oracle crops and a classical localization-plus-DSP pipeline would be helpful.
- Does routed specialization help beyond adding adapter capacity? Could you compare it with a parameter-matched shared LoRA model and report the effects of the shallow and deep routers separately?
- How do the proprietary MLLMs receive the raw I/Q sequence, and do they use the same tools? Was MERLIN fine-tuned on longEM-IQA after its patch size was changed, or was only the pretrained model evaluated?
4 comments
The authors have addressed my concern and I will change my score accordingly.
Thank you very much for your positive feedback. We are glad that our rebuttal has addressed your concerns. We sincerely appreciate your careful review and constructive suggestions.
Gentle Reminder
Dear Reviewer,
Thank you sincerely for your thoughtful engagement throughout the rebuttal discussion. We greatly appreciate the time and effort you have invested in evaluating our work, and we are encouraged by your indication that you are considering updating your score.
As the discussion period is drawing to a close, we would like to respectfully bring to your attention that the rating has not yet been updated in the system. We fully understand that you are busy, and we hope this serves merely as a gentle reminder. If our responses have adequately addressed your concerns, we would be very grateful if you could kindly reflect that in your updated rating before the deadline.
We remain happy to provide any further clarification should that be helpful.
Thank you again for your valuable time and consideration.
We thank the reviewer for the detailed comments on data generalization, the Zoom-and-Measure mechanism, routing, and baseline fairness. We provide the following clarifications and new results.
Q1. Data splits, OOD transfer, and EMRB. The original data comprise 27,135/561 longEM-IQA training/validation QA pairs, 3,300 longEM-Bench questions (11 tasks × 300), and 131,432/2,675 short-signal training/validation examples. The original longEM-Bench shares the simulator, nominal waveform categories, and parameter ranges with training, and is therefore an in-distribution (ID) test. We added OOD evaluations. For unseen radar bandwidths, PRIs, and duty cycles (1,000 questions), mixed SFT scored 71.12 (ID) → 41.33 (OOD) and EM-Lens 76.99 → 46.93. For new multipath profiles and time-varying channels (1,100 questions; normalized Doppler products 0.05/0.20), scores were 64.81 → 53.44 and 66.83 → 56.72, respectively. We also collected real continuous I/Q recordings (>1 million samples each) with a USRP B220 mini and constructed 800 questions across eight tasks from 30,000-sample windows. EM-Lens scored 33.69, compared with 28.43 for mixed SFT. We will clarify observation-level splits and QA-to-observation mappings in the revision.
Why not report a direct EMRB evaluation? We appreciate this suggestion. After inspecting EMRB's generation mechanism and conducting preliminary transfer experiments, we found that its evaluation requires a different source-separation capability. EM-Lens is designed for temporally localizable signal events: it identifies temporal boundaries, extracts a target interval via
zoom_in, and performs local perception or DSP measurement. EMRB's long I/Q observations are instead programmatically synthesized with multiple transmitters often coexisting in time, distinguished primarily by spectral characteristics. Temporal cropping cannot isolate an individual source in this setting, even with oracle boundaries; subsequent DSP estimation can reflect the mixed spectrum rather than the target transmitter. A direct score would therefore mix temporal event understanding with spectral source separation, beyond the current method's intended scope. Our OOD and USRP tests more directly assess the claimed capability; extending EM-Lens to frequency-selective separation remains future work.Q2. Localization and CoT/Zoom/DSP contributions. Independent signal-segment detection tIoU × 100 was 96.74 for long-signal-only SFT, 91.33 for mixed SFT, 95.35 for EM-Lens (SFT), and 94.96 for EM-Lens (SFT+RL). Start/end MAE were 1,423.50/1,025.44 samples for mixed SFT versus 245.09/1,040.47 for EM-Lens (SFT). Progressive ablations scored 33.0 → 48.5 → 49.0 → 69.5 for no CoT/Zoom/DSP, CoT only, CoT+Zoom, and CoT+Zoom+DSP, respectively; DSP adds 20.5 points. It was actually invoked on 1,860/3,300 questions (2,188 calls), including 83.94% of six parameter-estimation tasks. For radar bandwidth, the invocation/non-invocation groups scored 87.63/2.96 (descriptive, not causal).
Q3. Routing versus adapter capacity. longEM-Bench/EM-Bench scores were 64.55/62.60 (selected-layer shared LoRA), 61.89/63.00 (all-layer shared LoRA), 52.42/62.80 (Temporal Router only), 61.66/62.97 (Decision Router only), and 69.49/71.83 (full dual routing). The full model improves on selected-layer shared LoRA by 4.94 points / 9.23 percentage points. We will report exact trainable parameter counts to clarify capacity controls.
Q4. Closed-source MLLMs and MERLIN. Closed-source MLLMs receive serialized I/Q floating-point sequences in original sample order plus the question. They are not given EM-Lens's
zoom_inor DSP tools, although they may write and execute their own DSP code. In the original comparison, MERLIN's patch size was changed from 8 to 48, and the pretrained model was evaluated without fine-tuning (4.90). We additionally fine-tuned MERLIN using the same data and number of epochs as EM-Lens (SFT): it scored 58.61, versus 69.49 for EM-Lens. We will distinguish these baselines in the revision.We appreciate the reviewer's constructive suggestions.