- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces a forward underwater 3D reconstruction framework named Opti3R, designed to tackle the challenge of inconsistent depth and shape predictions arising from optical variations such as illumination, attenuation, and backscatter in underwater 3D reconstruction scenarios. Its core contributions are as follows:1. Geometrically Locked Optical Pairing (GLOP): This approach maintains the scene geometry, pixel coordinates, and camera parameters constant while applying optical perturbations solely to the reference image to generate paired samples. This constrains the model to preserve predictive invariance amidst optical changes.2. Visibility-Confidence-Reprojection Graph Supervision (VCRG): Leveraging the correspondence relationships from a teacher model, VCRG integrates visibility, endpoint confidence, and reprojection consistency to assign continuous reliability weights to cross-view supervised edges, thereby preventing the loss of valuable information through hard threshold masking.3. Axis Channel Geometry Adapter (ACGA): ACGA incorporates multi-scale residual blocks, initialized with identity mappings, into the dense depth and point cloud prediction heads. These blocks undergo joint optimization with the objectives of GLOP and VCRG.4. Validation: Comprehensive evaluations were performed on several publicly accessible underwater datasets, including SQUID, FLSea-VI, Sea-thru, FLSea-Stereo, Water3D, and SeaThru-NeRF. The results demonstrate that our framework surpasses existing baselines (e.g., Wat3R, VGGT) in monocular depth estimation, multi-view reconstruction, and relative pose estimation tasks.
Critical strengths
- By using the concept of "geometric locking" to decouple optical changes from scene geometry, the core pain point of geometric drift caused by water quality changes in the forward model of underwater images can be directly addressed. The theoretical motivation is sufficient and significant robustness improvement has been demonstrated in experiments.
2.Compared to the binary mask (hard filtering) used in traditional underwater reconstruction, VCRG introduces a continuous three factor weight that balances visibility, confidence, and reprojection consistency. This not only eliminates invalid matches but also preserves valuable mild evidence in low contrast areas, significantly improving the efficiency of cross view supervision.
Critical weaknesses
1.When processing real underwater images, GLOP relies on the optical path variable $l (x) $derived from decoupled teacher depth to artificially apply perturbations. This "approximate re rendering" rather than the pairing of real multi light and multi physical environment acquisition may introduce deviations that do not fully match the degradation of real physical water bodies.
2.Although the article mentions that raw Opti3R only adds a small amount of latency (8.54%) compared to Wat3R, the introduction of EMA teacher network, multi-level axis geometry adapter (ACGA), and complex graph weight calculation makes the specific memory usage and inference frame rate analysis insufficient when facing large-scale streaming reconstruction or resource limited devices.
- The overall objective loss function (equation 8) contains multiple weighting coefficients (such as $\ lambda $u=1.0, \ lambda $i=1.0, \ lambda $g=0.5, \ lambda $o=0.1 $, etc.), and the paper did not conduct ablation experiments or quantitative sensitivity analysis on the selection of these hyperparameters and their sensitivity to different water turbidity scenarios.
4.Although excellent performance has been achieved on datasets such as SQUID and FLSea, the teacher correspondence estimation (VCRG) of the model may fail under degraded extreme boundary conditions such as extreme turbidity, strong suspended particles, or complete loss of features caused by multiple scattering. There is a lack of boundary exploration on Failure Cases in the article.
5.The geometric backbone network and camera head of Opti3R are set to a frozen state during training, only adapted through lightweight optical heads and ACGA. Although this maintains the general geometric prior of the pre trained model, it may also limit the model's ability to fully adapt to certain specific complex underwater optical distortions.
Questions for authors
-
Regarding real data perturbation: In the optical perturbation formula (Equation 2) of actual underwater images, is using the teacher's depth $d (x) $to calculate the optical path sensitive to depth estimation errors? If there is a significant deviation in the depth of the teacher, will the disturbance introduce negative feedback?
-
Regarding hyperparameter design: Are the weights of each item in the loss function (such as $\ lambda. g=0.5, \ lambda. o=0.1 $) determined through grid search? Do these weights need to be re tuned when facing datasets with a wide range of water quality?
2 comments
Q2 — Grid search and retuning. We used a compact one-factor sweep, not a full joint grid search, and used one coefficient setting across the underwater datasets. Table S15 reports the tested values and severe-water sensitivity; for every listed parameter, the chosen default is the best of its low/default/high settings. We have added the selection protocol to Supplementary Appendix H and the final coefficients remain in Sec. 3.5. The sweep supports a fixed choice over the evaluated conditions without implying that one setting is optimal for every water body.
We appreciate your push to test costs and failure modes alongside accuracy. We hope these measurements make the revised paper substantially more useful, and we would be grateful if you would reconsider your assessment.
Thank you for giving us time to follow through on the tests we outlined. We have added the optical-path, parameter, stress, capacity, and view-scaling results to Supplementary Appendix H. They also helped us make the Discussion more precise about where Opti3R works well and where the evidence becomes thin.
W1 — Real-image optical perturbation. The real-image branch changes appearance using an optical path computed from detached teacher depth. We describe it in Sec. 3.2 as a geometry-preserving training intervention, with the teacher-depth error affecting perturbation strength. We tested that dependence by adding relative depth noise only to the path: Water3D error is 0.332 with the original path, 0.335 at 10% noise, 0.340 at 20%, 0.356 at 40%, and 0.367 with a constant path (Supplementary Table S16). We also checked acquired SQUID images by visibility and both FLSea-VI evaluation scenes; Opti3R improves on Wat3R in each reported group (Table S11). A geometry-calibrated capture of one scene in several real water conditions would extend this test. Sea-Thru and SeaThru-NeRF show why direct attenuation and scattering deserve that kind of controlled acquisition.
W2 — Memory, speed, and scaling. The EMA teacher and correspondence graph are used in training; raw inference runs one student predictor. On a 24-GiB RTX 4090, Opti3R inference takes 0.89 s/17.5 GiB for 8 views, 1.86 s/20.8 GiB for 16, and 3.94 s/23.1 GiB for 32. The corresponding training steps take 2.24 s/22.4 GiB, 4.56 s/23.0 GiB, and 9.37 s/23.8 GiB (Supplementary Table S19). Supplementary Table S7 retains the matched 8-view Wat3R comparison. These are timings for a set of views; sustained streaming FPS would also include input, output, and persistent-state costs. VGGT likewise makes view-count scaling an important part of evaluating feed-forward geometry systems.
W3 — Loss weights and water conditions. We selected the coefficients through a one-factor sweep on held-out DTU validation scans, then kept (λu,λi,λg,λo,τ)=(1,1,0.5,0.1,1) fixed across the reported underwater evaluations. Supplementary Table S15 gives low/default/high values for every coefficient and τ on overall and severe-water Water3D. For example, λg=0.25/0.5/1 gives overall errors 0.339/0.332/0.336 and severe-water errors 0.401/0.389/0.396. The default is best among the tested choices in each one-factor comparison. This establishes local sensitivity around the selected setting; a joint grid would answer a different question about interactions.
W4 — Extreme turbidity and feature loss. We have added a controlled stress test that increases attenuation and backscatter while reducing feature visibility on the same scenes. From mild to extreme severity, valid VCR edges fall from 0.83 to 0.21, SQUID relative depth error rises from 0.084 to 0.187, and Water3D error rises from 0.332 to 0.458 (Supplementary Table S17). The revised Discussion names this loss of correspondence evidence as a failure boundary. Real suspended-particle and multiple-scattering sequences with independent geometry would be a valuable next test of that boundary.
W5 — Frozen-backbone capacity. Secs. 3.1 and 4.1 now explain that optical modulation changes the input to the frozen camera head. We also trained two matched-budget unfreezing controls (Supplementary Table S18). The frozen configuration has 14.1M trainable parameters and gives 0.332 Water3D error; unfreezing the camera head gives 15.4M and 0.330; additionally unfreezing the last backbone block gives 27.6M and 0.327. Extreme-condition depth error moves from 0.187 to 0.184 to 0.182. More trainable capacity helps modestly, with a clear parameter cost. AdaptFormer offers a useful general precedent for adapting a fixed vision transformer; our control tests that trade-off for underwater geometry.
Q1 — Teacher-depth error and feedback. The teacher depth used for the optical path is detached during each student update. This blocks a direct gradient path through the perturbation, while the EMA teacher can still carry bias across updates. We isolated path error by changing only the path variable and keeping the teacher geometry target fixed. The measured 10%, 20%, and 40% noise results are 0.335, 0.340, and 0.356 Water3D error, compared with 0.332 for the original path (Supplementary Table S16). The trend shows graceful degradation at smaller errors and a meaningful cost at larger ones.