- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper tries to private split VLM inference on smart glasses. It keeps the prior TGAP token-protection transform, reduces the input pixel budget whild maintaining the whole struture of Qwen visual encoder. The experiment shows that the latancy reduce 39% and has less tempreature raise.
Critical strengths
Real-device measurements, e.g. latency, memory, temperature, etc. are rare and valuable.
Critical weaknesses
Privacy is assessed only by prompting the same frozen reader with containment/accuracy rates, with no trained probes or reconstruction attacks on the 256-d packet. One of the central claim of joint quality-and-hardware optimization is not validated end to end. what the reviewer understood is the utility comes from the software path, not the deployed INT8 graphs? and the Device measurements are single runs, and TGAP-HR's latency/temperature differ widely between Table 2 and Table 4, this should be explained.
Questions for authors
Are TGAP-HR and SAGE both INT8 on-device with the same runtime? What is utility of the actual deployed INT8 graph? How do conclusions change if L star is not set to 10s?
3 comments
good response but the contribution is not satisfied with ICLR quality
the author has reply to each of the review's question, the reviewer found more detailed information to support this methos is workable. but the technical contribution of this paper still not reach score 3 since the technical novlty is somehow limited.
Thank you for acknowledging that the additional experiments answer your questions and support the method's operation. We understand that your remaining concern is the level of technical contribution, rather than those validation questions.
The contribution we ask you to assess is the protected split-inference design on smart-glasses hardware: reducing visual work and post-protection transmission while retaining vision topology and the frozen reader. The measurements distinguish this choice from alternatives that appear attractive from parameter count or storage alone: depth reduction loses answer quality, while mixed INT4 is 44.38% smaller yet 64.78% slower than full-depth INT8. The resolution/codec ablation separates compute savings from communication savings, and actual-device QA connects deployed representations to downstream answering. These findings support a hardware-grounded system-design contribution, not a new quantizer, codec primitive, or privacy transform. We appreciate that the significance of this contribution remains the point on which your assessment differs; the added evidence clarifies what the design establishes without claiming algorithmic novelty for its individual components.
We would like to thank you once again for your constructive comments on this manuscript, which will be of great value in guiding our future work on the manuscript
Thank you for recognizing the real-device evaluation. We hope you can reconsider rising your rate after reading our detailed rebuttal.
Q1. Are TGAP-HR and SAGE both INT8 on-device with the same runtime?
Yes. Both run on the same Mentra Live glasses with ONNX Runtime, four CPU threads, and dynamic per-channel INT8 linear operators; geometry, normalization and unsupported operators retain native precision. Both use fixed-grid graphs, the frozen Qwen reader and the same TGAP transform. The artifact audit verifies this policy across the six-method measurement. The reported 39.18% inference gain is therefore within the same execution policy, not an INT8-versus-FP32 comparison.
Q2. What is the utility of the actual deployed INT8 graph?
We evaluated real glasses outputs on 617 paired images, holding questions and scoring fixed across all paths:
SAGE's actual-device utility equals its host-INT8 value on these images; actual-minus-software is -0.60 points, paired 95% CI [-3.53,2.36]. Actual SAGE/HR P.Acc is 37.92/40.38%, P.WR 16.99/18.58%, and P.Cont 11.70/11.32%. This directly evaluates deployed representations rather than substituting software features for device outputs; the original three-seed software results retain their separate sample scope.
To address your end-to-end concern, we also completed 64 fresh file-to-answer requests: 16 images x two methods x two repeats. Each includes glasses inference, Wi-Fi ADB transfer, decoding and final generation on a resident host reader. Mean total time falls 56.26->40.71 s, a 27.64% reduction with paired 95% CI [22.34%,33.25%]. One host clock includes loading, control overhead and post-upload guard waiting. These requests connect actual deployed computation to final answers. The separate phone experiment establishes 192/192 packet deliveries; the full-response endpoint here is the host reader.
Q3. How do conclusions change if the latency reference is not 10 s?
Keeping R's formula unchanged, SAGE scores 1.409/1.409/1.369/1.141 at 5/8/10/12 s versus HR=1.000. The favorable trade-off persists across this range. At 1 s, tiny students rank higher; at 16/20 s, HR ranks higher as its latency penalty disappears. R is a requirement-based index, so we will show its sensitivity alongside raw metrics. Measured inference, temperature, packet and complete-response gains do not depend on R.
Critical Weaknesses: direct privacy attacks
We trained 36 probes: four representation conditions x mean/Transformer/metadata probes x three initializations on one deployment split. Inputs use final host-INT8 graphs after packet serialization/dequantization. Probe training/selection filters known author overlap, exact images and conservative near-duplicates against evaluation. Supported sex/income/country counts are 86/52/305.
Observed recovery decreases in five of six content-probe comparisons. Mean country recovery falls 5.33 points, paired 95% CI [-10.16,-0.64]. This adds independent recovery evidence beyond reader prompting.
Critical Weaknesses: repeated measurements and Tables 2/4
The new same-session study covers three fixed grid pairs x four resolution/codec cells x five repeats. All 60 requests succeed under unchanged cooldown/safety rules.
Paired 95% latency intervals are [-8.286,-7.503], [-7.239,-3.682] and [-8.097,-4.334] s, all favoring SAGE. Mean sensor rise decreases from 8.14/8.80/8.39 C to 6.16/4.88/6.95 C. Table 2 is the six-method comparison; Table 4 is the earlier depth/precision session. We will label their distinct sessions and add these repeats: within-session comparisons reproduce the benefit without pooling absolute measurements across runs.
Ethics
New experiments reuse existing benchmark records and annotations, without new participant recruitment or wearable image capture. The design retains the trusted-device boundary. The paper's Ethics Statement addresses source identifiers, controlled artifact access and consent-aware deployment.