- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes OccWeave, which adopts a frozen SAM images features as priors to improve cooperative semantic occupancy prediction, which currently suffers from boundary distortion, broken continuity, thin-structure omission, and thin-structure thickening. Structure-Prior Feature Refinement (SPFR) associates these features with local 3D representations and adds them through a learned gate. Structure-aware Cooperative Reliability Fusion (SCRF) then weights collaborators using their refined features, refinement residuals, feature discrepancies, and relative poses. OccWeave is implemented and has shown gains on both CoHFF’s voxel representation and VOGS-CP’s Gaussian representation.
Critical strengths
- Clear motivation that current CSOP methods suffer from boundary distortion, broken continuity, thin-structure omission, and thin-structure thickening.
- OccWeave is generalizable to both voxel and Gaussian representations, and diverse foundation model priors including CLIP/DINOv2/SAM.
Critical weaknesses
- VQSOP also falls into Voxel category, yet OccWeave is not implemented and evaluated upon. It would be useful to assess how OccWeave performs upon a stronger Voxel method.
- Overhead analysis is missing. CSOP is communication and latency sensitive. OccWeave extracts foundation model priors offline which is not practical in real-world. In addition, SCRF requires collaborators’ refined features, refinement residuals, feature discrepancies, and relative poses, further adds communication overhead.
Questions for authors
- Could the authors clarify how much communication and latency overhead does OccWeave have on voxel and Gaussian representations?
- Could the authors specify what exact information is transmitted in OccWeave?