- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes AFE-EQA, a framework that treats the current answer as a falsifiable hypothesis and actively seeks discriminative visual evidence during embodied exploration. It integrates three-state grounding, counter-evidence memory, falsification-aware imagination, and a learned terminal resolver. Experiments on HM-EQA improve accuracy from 58.0% to 62.0% with the Prism backbone.
Critical strengths
- Interesting formulation. Treating answer hypotheses as falsifiable provides a meaningful perspective on evidence acquisition beyond confidence-driven exploration.
- Coherent framework. The integration of exploration, structured memory, and answer revision forms a well-motivated reasoning pipeline.
Critical weaknesses
- Insufficient evidence for the central claim. Falsification-aware exploration improves accuracy by only 1 percentage point (58% to 59%), while the learned terminal resolver contributes another 3 points. Moreover, the paper does not directly evaluate recovery from early high-confidence errors, despite this being its primary motivation.
- Overly verbose and defensive writing. Excessive implementation details and repeated qualifications sometimes obscure the main narrative. A more concise presentation would help highlight the core contributions.
Questions for authors
- Effectiveness of active falsification: Can the authors directly evaluate recovery from early high-confidence errors and demonstrate the benefits of falsification-directed exploration independently of the learned terminal resolver?
- Component contributions: Can the authors provide finer-grained ablations of three-state grounding and counter-evidence memory, and evaluate the terminal resolver on baseline exploration trajectories?