- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The authors propose a system called DEPTHUMI. To address the problem of recovering accurate trajectories and obtaining reliable 3D information under occlusion and rapid camera motion with handheld UMI devices, they provide an active-depth-based UMI system. The method is complete and rigorous, and its effectiveness can be seen directly. This is a good system-level work for UMI. However, from a reader's perspective, the readability is very poor. It is very difficult to understand the entire paper. In addition, the novelty in terms of learning is limited. The manuscript needs to be completely restructured. The current presentation is unlikely to meet ICLR standards. I suggest that the authors not rely on AI-assisted writing. They should remove most of the technical terms from the main text and move the technical and implementation details to the appendix. At the same time, the appendix should also be carefully restructured. It only needs to explain the system clearly. The specific details can be placed in a public repository. If there is no further novelty in learning, I suggest that the authors submit the paper to a top robotics conference or journal after restructuring the manuscript.
Critical strengths
- The experiments are complete and rigorous. The evaluation protocol is well standardized, and many engineering details are clearly described. This provides sufficient information for readers to reproduce the work.
- Figures 5 and 7 clearly show the advantages of the method. The difference between factory depth and learned depth is obvious.
Critical weaknesses
- The readability of the paper is very poor. It makes the paper very difficult to read. The work itself is complete, but the manuscript is not well organized. Some parts read like an experimental report. The logic in some parts of the manuscript is poor, which may be caused by AI-assisted writing. I suggest that the authors further improve the readability of the manuscript. The authors may understand the AI-generated language, but it is very difficult for readers encountering this work for the first time. Terms such as DP and DP3 should be written in full and cited when they first appear, such as Diffusion Policy and 3D Diffusion Policy. Experimental protocols such as RGB DP, DP3–Raw, and DP3–Active appear repeatedly in the paper without being defined. This will confuse readers. Content like Section 3.3 should be placed in the appendix. Readers do not care about data such as the reprojection errors reported there. At the same time, the structure of the appendix is also unclear. Figure 2(b) has very poor readability. It is difficult to understand the conclusion the authors want to convey. The same problem also appears in Figures 5(g) and 5(h).
- The main contribution of the method is system integration. I did not find any new contribution in learning. This does not seem to fit the scope of ICLR.
Questions for authors
- Judging from the demonstration video, the learning-based depth method seems quite slow. What are its frame rate and latency during deployment?
- Have the authors tried changing the projector power? Is the comparison with DP3–Raw fair?
Response to Reviewer oF5X: Manuscript Reorganization, Empirical Contribution, Chunk Latency & Projector Sweep
We sincerely thank Reviewer oF5X for recognizing that our method and experiments are "complete and rigorous", our evaluation protocol is "well standardized", and our visual comparisons clearly demonstrate the advantage of learned active depth over factory stereo depth.
Above all, we take your critique on readability, organization, and AI-assisted phrasing to heart. Re-reading our initial submission from a fresh reader's view, we fully agree that undefined policy shorthand, low-level calibration metrics in §3, small tracking curves, and repetitive appendix tables made the paper read like an engineering report rather than a clear research paper.
1. Structural & Readability Revision Preserving the Core Storyline (W1)
In the revised PDF (10-page main text), we preserved the exact same research problem, hardware, tasks, and storyline, while reorganizing and rewriting the paper for clarity:
2. Empirical Visuomotor Insight for ICLR (W2)
We do not claim a new diffusion architecture or learning objective; rather, DepthUMI contributes a controlled empirical study of close-range 3D representations for wrist-only imitation learning. Under identical demonstrations, action labels, DP3 PointNet+DDIM architecture, 4,096-point FPS sampling, and training budgets (App. C.2 Table 12), feeding factory wrist depth into DP3 (DP3-Raw, 20% [6/30]) underperforms even a 2D RGB baseline (DP, 30% [9/30]) because built-in matching drops ~79% of close-range ROI pixels (8–25 cm) around fingers and thin edges. Replacing raw depth with neural structured-light decoding (DP3-Active) lifts success from 20% to 67% (20/30)—rising from 0% to 70% on Peg Insertion and 10% to 50% on 5 mm-clearance Block Extraction (§4.3 Table 3). This identifies close-range geometric completeness as a key bottleneck in scaling portable wrist interfaces to 3D policies.
3. Chunked Control Timing, Latency & Demo Video Duration (Q1)
4. IR Projector Power Sweep (Levels 0–6) & Matched DP3-Raw Setup (Q2)
Sweeping all 7 Gemini 335 projector levels under fixed exposure (3,000) and gain (16) (§4.4 Table 5, App. Fig. 12) shows that adjusting projector power alone never eliminates close-range factory holes: Level 0 (off) drops full-frame factory coverage to 19.39% (8.80% close-range ROI), Level 1 (ours) reaches 53.60% full-frame and 20.83% close-range ROI coverage at 1.23% IR saturation, and Levels 2–6 saturate up to 52.57% of close-range pixels while close-range factory coverage stalls at 21.09%–23.15% (~77%–79% missing). Note that 100% for the dense learned decoder reflects output completeness rather than ground-truth accuracy; task-level geometric fidelity is validated in Table 3 under matched Level 1 acquisition and 4,096-point FPS preprocessing.