- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
Memo3R uses existing datasets and reconstruction metrics to diagnose memory in online 3D reconstruction across four dimensions: persistence, plasticity, robustness, and compactness.
Critical strengths
The problem studied in this paper, how to comprehensively evaluate the memory used in online 3D reconstruction, is highly valuable to research in this field.
Critical weaknesses
- As a benchmark study, this paper still relies entirely on existing datasets and commonly used quality metrics. The four proposed capabilities are evaluated mainly through different input settings, which remains considerably limited.
- Regarding the compactness, I believe the proposed evaluation primarily measures how well different memory mechanisms tolerate repetitive frames and high-density observations. However, it does not introduce appropriate metrics for measuring changes in memory usage, information compression ratios, or the actual amount of information retained under these input settings. Therefore, I do not believe that the current evaluation truly measures “compactness”.
Questions for authors
- Please check the weaknesses.
- I would like the authors to provide a more convincing way to evaluate “compactness”.