- Rating
- 3(+1)
- Confidence
- 1(−1)
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes DisCo, a framework for localizing a single RGB image within a 2D floorplan under spatial and directional ambiguity. The method first predicts ray distances to generate geometrically plausible camera poses, then applies SE(2)-aware candidate suppression and an image–floorplan compatibility model to rerank them. Main contribution includes pose-structured contrastive learning, which combines perturbed positive poses with position and orientation negatives to distinguish competing hypotheses. Experiments on Structured3D, Gibson, and ZInD report improvements over geometry-based localization and other baselines. Ablation studies examine the contrastive objective, pose perturbations, negative sampling, and candidate selection, with additional evaluations of floorplan corruption, runtime, and sequential tracking.
Critical strengths
- The paper addresses an important problem in visual floorplan localization. Repeated indoor structures can produce multiple geometrically plausible poses, making reliable localization difficult even when ray predictions are accurate. The motivation for explicitly resolving spatial and directional ambiguity is clear and practically relevant, particularly when only an RGB image and a floorplan are available.
- The method shows applicability across datasets and candidate generators. Experiments cover Structured3D, Gibson, and the real-world ZInD dataset, with additional evaluations using different candidate generators. These results support the usefulness of DisCo as a module for improving existing localization systems, which strengthens the practical significance of the contribution.
Critical weaknesses
-
The evaluation protocol needs clarification. The provided Gibson configuration uses the test set for validation and checkpoint selection. If this was used for the reported results, it could bias the evaluation and affect comparison fairness. The authors should confirm that model selection used an independent validation set.
-
The comparison with standard contrastive learning is not sufficiently clear. The paper reports substantial improvements over InfoNCE but only states that the candidate generation pipeline is the same. Differences in network architecture, positive and negative sampling, and training budget are not fully explained. The authors should clarify these settings to better establish which specific designs account for the improvement.
Questions for authors
-
Clarification on model selection: Which split was used to select checkpoints for the reported results? The provided Gibson configuration uses the test split for validation. Does this reflect the actual experiments, and are results available with independent validation-based model selection?
-
Could the authors clarify what differs between the InfoNCE baseline (59.9% joint recall) and DisCo without position and orientation negatives (70.0%)? Is this gap due to slack positive sampling, or are there other differences in the network or training settings?
Dear Reviewer 8vKN,
Thank you for your detailed feedback. We would appreciate it if you could take another look at our responses and let us know whether your concerns have been adequately addressed.
Thank you for your time and consideration.
Best regards,
The Authors