- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2(+1)
Read review
Paper summary
This paper presents ViWi, which is a multimodal framework that combines vision and RF signals for voxel-level estimation of 3D object mechanical properties, including Young's modulus, Poisson's ratio, and density. ViWi replaces independent voxel-wise regression with a material-slot representation that groups voxels based on visual and material-latent compatibility and predicts shared slot-level properties. The framework incorporates RF signals in the 2.4 GHz Wi-Fi band, summarized as an RF descriptor, to condition the voxel-level property estimation. Experiments on GVM demonstrate overall improvements over existing methods. The paper also provides ablation studies on the material-slot formulation and RF design, as well as downstream physics simulations using the predicted material fields.
Critical strengths
[+] The paper explores an interesting research direction. Estimating the mechanical properties of 3D objects is a challenging problem, particularly when objects of different materials with similar visual appearances. The idea of incorporating RF signals to complement visual observations is interesting and provides a new perspective on addressing this challenge.
Critical weaknesses
[-] The sensing hardware setup is unrealistic. Despite the name ViWi (Vision Meets WiFi), the proposed system relies on a sensing configuration that is substantially more complex than commodity WiFi devices, involving 16 transmitters and 32 receivers distributed on concentric spheres around the target object. I understand that the work focuses on RF sensing in the WiFi frequency band rather than necessarily using commodity WiFi devices. However, I am concerned that such a complex sensing setup would be difficult and costly to deploy in practice. Moreover, the motivation for employing such complex setup for estimating a few mechanical properties of an object is not sufficiently justified. It is unclear whether this approach offers practical advantages over existing professional material characterization or measurement instruments.
[-] The RF sensing process relies on unrealistic assumptions. The work uses ray tracing in Sionna RT to simulate RF propagation at 2.4 GHz. However, several aspects of the simulation rely on idealized assumptions. First, the simulation explicitly disables the LoS propagation paths, which does not reflect typical real-world wireless sensing conditions. Second, the proposed RF descriptors rely on path-level information, including path coefficients, propagation delays, and single-path gains, which can be directly obtained from the ray-tracing simulator but are difficult to extract from real-world wireless measurements such as WiFi CSI, RSSI, or CIR. In practice, signals from different propagation paths are superimposed at the receiver, making it challenging to isolate individual paths and obtain their properties accurately. Consequently, I am concerned that the proposed framework may face substantial challenges when deployed in real-world environments, potentially limiting its practical applicability and impact.
Questions for authors
-
What is the impact of enabling or disabling the LoS paths? The RF simulation explicitly disables the Los paths to isolate object-dependent scattering. However, direct paths are present in practical wireless sensing scenarios. In particular, how would including the direct Tx–Rx propagation paths affect the RF descriptors and the resulting mechanical-property estimation accuracy?
-
The proposed RF descriptors rely on path-level signal information. While these quantities can be obtained from the Sionna RT simulator, they may be difficult to estimate from real-world wireless sensing setups. Could the authors clarify how these features would be extracted from practical wireless signals? Additionally, what signal bandwidth and measurement resolution are assumed in the simulation?
-
The simulation uses 16 Tx and 32 Rx distributed around the target object. Could the authors further justify the necessity of such a complex sensing configuration for estimating object mechanical properties? What practical advantages would this approach offer compared with existing material characterization techniques, and to what extent could the sensing configuration be simplified without substantially sacrificing estimation accuracy?
7 comments
Q2. Extracting the descriptor from practical signals; bandwidth and resolution
Assumption in the paper. The descriptor in the paper uses path-level quantities from Sionna RT, i.e., an ideal measurement with unlimited bandwidth and no noise. We will state this explicitly in the revision.
Features from real signals. We now compute the descriptor only from what commodity WiFi hardware reports:
- CSI (e.g., Intel 5300 CSI Tool, Atheros CSI Tool, Nexmon): 2.4 GHz, 40 MHz channel (the widest in this band), 114 subcarriers, with thermal noise (20 dBm transmit power, 7 dB noise figure) and a random gain error per measurement (1% amplitude, 1° phase). The four features per transmitter become: total received power; fraction of receivers above 10× the noise floor; strongest tap of the impulse response (IFFT, 25 ns taps); and RMS delay spread.
- RSSI only (available on every WiFi device): received power per link, computed from the same noisy CSI, rounded to 1 dB and measured with and without the object; per transmitter we keep the total power change and the fraction of receivers that change by at least 1 dB.
Bandwidth and resolution. At 40 MHz the delay resolution is 25 ns (7.5 m of path length), while the delay spread caused by an object (scaled to 1 m) is only 0.35 ns on average. Fine timing is therefore not usable in practice, and the model must rely on power-based features.
Table R2. Descriptor from realistic signals (16 Tx + 32 Rx; GVM test set, 148 objects, step 112k).
| RF input | E ALDE↓ | E ALRE↓ | ν ADE↓ | ν ARE↓ | ρ ADE↓ | ρ ARE↓ | Mean↓ |
|---|---|---|---|---|---|---|---|
| ViWi, Table 1 - main paper (8 GPUs; LoS off, ideal paths) | 0.1797 | 0.0196 | 0.0151 | 0.0515 | 198.22 | 0.1034 | 5.81% |
| (A) LoS off, ideal paths (paper setting) | 0.1943 (±0.20) | 0.0210 (±0.025) | 0.0148 (±0.014) | 0.0508 (±0.051) | 200.11 (±203) | 0.1087 (±0.096) | 6.02% |
| (D) LoS off, 40 MHz CSI + noise | 0.2009 (±0.23) | 0.0218 (±0.028) | 0.0145 (±0.014) | 0.0498 (±0.049) | 195.50 (±212) | 0.1077 (±0.104) | 5.98% |
| (C) LoS on, 40 MHz CSI + noise + subtraction | 0.1914 (±0.22) | 0.0205 (±0.026) | 0.0153 (±0.016) | 0.0526 (±0.056) | 189.32 (±236) | 0.1055 (±0.111) | 5.95% |
| (E) LoS on, RSSI (1 dB) + noise + subtraction | 0.1942 (±0.22) | 0.0210 (±0.026) | 0.0157 (±0.014) | 0.0540 (±0.050) | 190.59 (±227) | 0.1029 (±0.098) | 5.93% |
Results. All three realistic settings include thermal noise and gain errors. Realistic CSI with noise costs no accuracy (D: 5.98% vs. A: 6.02%), the full practical pipeline with LoS, noise and subtraction gives 5.95% (C), and even noisy 1 dB RSSI gives 5.93% (E); all are better than vision only (6.34%, Table R1). The reason is that the material information lies in how much the object reflects, absorbs and blocks the signal on each link, i.e., in the received power that every WiFi device measures, and not in fine path details that only a simulator provides. We will add this measurement model and Table R2 to the appendix.
Q3. Complexity of the sensing configuration and practical advantages
Why 16 Tx and 32 Rx. The sphere was chosen as a controlled, orientation-independent setup to test whether RF adds information to vision, similar to dense multi-view rendering on the vision side. It is not a deployment requirement, and the links need not be measured at the same time: a single Tx–Rx pair could collect them one after another, e.g., by moving one antenna while the object rotates on a turntable.
How far it can be simplified. We tested the most practical setup (G): only 2 transmitters and 4 receivers (8× fewer of each), placed around the object with the placement rule of the paper, RSSI only (1 dB), with the direct path present and the empty scene subtracted, i.e., 4 numbers instead of 64.
Table R3. Simplified sensing configuration (GVM test set, 148 objects, step 112k).
| Configuration | E ALDE↓ | E ALRE↓ | ν ADE↓ | ν ARE↓ | ρ ADE↓ | ρ ARE↓ | Mean↓ |
|---|---|---|---|---|---|---|---|
| ViWi, Table 1 - main paper (8 GPUs; 16 Tx + 32 Rx, LoS off, ideal paths) | 0.1797 | 0.0196 | 0.0151 | 0.0515 | 198.22 | 0.1034 | 5.81% |
| (A) 16 Tx + 32 Rx, LoS off, ideal paths (paper setting) | 0.1943 (±0.20) | 0.0210 (±0.025) | 0.0148 (±0.014) | 0.0508 (±0.051) | 200.11 (±203) | 0.1087 (±0.096) | 6.02% |
| (G) 2 Tx + 4 Rx, LoS on, RSSI (1 dB) + noise + subtraction | 0.2088 (±0.24) | 0.0223 (±0.027) | 0.0137 (±0.014) | 0.0456 (±0.046) | 193.86 (±246) | 0.1008 (±0.106) | 5.62% |
| Vision only (no RF) | 0.1985 (±0.22) | 0.0216 (±0.026) | 0.0158 (±0.014) | 0.0549 (±0.049) | 196.33 (±256) | 0.1139 (±0.112) | 6.34% |
The minimal setup (G) reaches 5.62%, clearly better than vision only (6.34%; lower error on 92 of 148 objects), with the best Poisson's-ratio and density errors, while Young's modulus is slightly worse. (G) is even below the full setup (A). We do not claim that fewer antennas are better; a likely reason is that (G) keeps the direct path, which (A) removes: as shown in Q1, the links blocked by the object add information (B: 5.80% vs. A: 6.02%). The main point is that the simple setup loses no accuracy, because the material information lies in how much the object changes the received power on each link, and a few links around the object already capture it.
Practical advantages. Existing RF material characterization (open-ended coaxial probes, waveguides, resonant cavities, free-space methods) measures εr and σ with laboratory instruments such as a vector network analyzer, and requires either a sample of known shape (e.g., cut to fit a waveguide or cavity, or a flat slab for free-space methods) or direct contact with the material (coaxial probes); it gives no mechanical properties. Mechanical tests (tensile tests, indentation, ultrasound) usually need contact, prepared specimens or specialized laboratory equipment. Our approach (i) needs no contact and no sample preparation; (ii) uses signals that commodity WiFi devices already provide, with RSSI alone being sufficient in our experiments; and (iii) estimates full volumetric fields of E, ν and ρ for the whole object, using RF as a compact cue that complements vision. It is not meant to replace precise laboratory measurements, but to give fast, whole-object estimates where such measurements are impractical.
We thank the reviewer for the expert reading from the wireless-sensing perspective. The three questions point exactly to the gap between simulation and practice. To answer them with evidence, we re-simulated the RF descriptors of all 1,560 objects under five new sensing settings and retrained the model for each. In short:
Protocol. Due to limited time and compute, each new model was trained on 1 GPU (batch size 16) instead of 8 (batch size 128) for the same 112k steps, i.e., with 8× fewer samples, so errors are slightly higher than in Table 1 (6.02% vs. 5.81% for the identical RF input). All new models start from the same vision-only checkpoint ViWi†, use the same hyperparameters and the same 148 test objects, so their rows are directly comparable. The italic first row of each table repeats ViWi from Table 1 (8 GPUs); the mean is the average of ALRE(E), ARE(ν) and ARE(ρ); best 1-GPU values are in bold.
Q1. Impact of enabling the line-of-sight path
Settings. We compare three versions of the RF input (Table R1):
Table R1. Effect of the line-of-sight path (16 Tx + 32 Rx; GVM test set, 148 objects, step 112k).
Why LoS does not hurt. The direct path does not touch the object, so it carries no material information, but it does not remove any either: the signal scattered by the object is simply added on top of it. Since the direct path is almost identical for all objects, it acts as a constant offset, while the object-dependent part remains. LoS even adds information: the receivers that are no longer reached show which direct links the object blocks, i.e., its size and extent. This plausibly explains why (B) gives the best Poisson's-ratio and density errors and the lowest mean error (5.80% vs. 6.02% for A).
Why (C) is slightly worse than (B). In a real measurement, the direct path is about 35 dB stronger than the signal from the object, so subtraction must cancel a very strong signal using two noisy measurements. A gain error of only 1% in amplitude and 1° in phase already leaves a residue of the direct path that is about as strong as the object's signal, and thermal noise and the 40 MHz bandwidth add further errors. (B) is free of all these errors, i.e., the ideal case. Even so, (C) stays at the level of the paper setting (5.95% vs. 6.02%) and below vision only (6.34%), with a lower error on 96 of the 148 objects. The reason is that each feature combines many subcarriers and receivers: the residue is random and averages out, while the effect of the object is consistent across all measurements.
Conclusion. Turning LoS off in the paper is not a requirement of the method. It isolates the object's signal in simulation, which empty-scene subtraction achieves in practice without loss of accuracy.