- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2(+1)
- Soundness
- 2
Read review
Paper summary
This paper has a reasonable setting, and the proposed persistent object memory also takes into account challenges such as uninteracted objects, motion changes, and contextual information, and has certain research value. However, the quality of the paper's presentation is poor, which seriously affects understanding. As a conference paper, it lacks condensation of the main core content of the article and instead scatters various details. Meanwhile, the main text heavily relies on supplementary materials, and the boundary between method innovation and engineering combination is also unclear.
Critical strengths
The problem has clear research value. The paper focuses on a very crucial but not yet fully resolved issue in embodied intelligence: how intelligent agents can retain the information of objects that are currently not important but may be queried in the future.
The motivation and module design are largely consistent. The retention of objects that have not been touched corresponds to the problem of memory coverage; repeated displacement evidence corresponds to positioning noise; context description makes up for the deficiency of only saving coordinates; historical records support cross-time querying.
Cross-task and cross-dataset validation is relatively sufficient. HD-EPIC, UCS-Bench, and VQ3D cover different issues such as position, motion, relationship, and positioning, which can reflect the applicable scope of this memory representation.
Critical weaknesses
The article structure lacks conciseness. As a conference paper, it fails to condense the core content of the article. Instead, it simply scatters various details. The main text heavily relies on supplementary materials, and readers need to consult the supplementary materials to fully understand the methods and experimental logic.
The innovation and engineering aspects of the method are confused. Detection, three-dimensional enhancement, object association, language description, and language model reading are mostly existing components. The current version has not fully explained the new methodological contributions of LEDGER or whether performance improvement is mainly achieved through engineering combination.
The experimental content is too scattered. Multiple datasets, scene stitching, answerers, and construction variants all have certain value, but currently they are more like a collection of separate experimental projects. We suggest organizing the main text around a core conclusion and moving the remaining results to the supplementary materials.
Questions for authors
-
What is the paper's single central claim, and which parts of LEDGER constitute the novel methodological contribution according to the video-reasoning setting this paper concerns?
-
Which experiments are intended to support the main claim, and which are exploratory analyses? In particular, how should readers interpret the roles of the multiple datasets, scene-stitching experiments, answering models, and construction variants in relation to the paper's central contribution?
-
The main text should contain sufficient information for readers to grasp the paper’s core idea, reasoning, and conclusions without relying heavily on supplementary material.
5 comments
Following up
We thank the reviewer again for their time and thorough review. We wanted to check whether our response sufficiently addressed their concerns. If there are any remaining questions, we would be happy to answer them until the discussion deadline on 18th November.
Sincerely,
Authors
Following up
We thank the reviewer once again for their feedback on the organisation of our paper. We have addressed all the points raised and clarified the key takeaways and conclusions drawn from our experiments to further strengthen the paper. With only about a day remaining in the discussion period, we would like to kindly ask whether the reviewer has any remaining concerns that we could address before the deadline.
Sincerely, Authors
Response to reviewer ZXFy
We thank the reviewer for the feedback on the paper's organization. The weaknesses and the questions raise the same three points, so we answer them in pairs: Weakness 2 with Question 1, Weakness 3 with Question 2, and Weakness 1 with Question 3. We also describe the changes made in the revision.
Central claim. A persistent 3D object memory lets a language model answer spatial questions that were not known in advance, without going back to the video. The memory needs three properties: (1) it keeps every object it sees, including after the object leaves view, (2) it keeps a history of where each object rested, and records a move only after repeated evidence, and (3) it stores a short description of the object's context at each resting place. With this memory and no images, GPT-5.4's accuracy improves from 29.7% to 42.6% on HD-EPIC and from 33.8% to 38.5% on UCS-Bench (Tables 2 and 3). The revised introduction now states this claim in one sentence.
What is new and what is existing. The reviewer is right that the detector, 3D lifter, tracker and language model are existing components. Our contribution is the object record these components fill: which objects are kept, how a move is told apart from localization noise, and what is stored for each resting place. The revised Figure 2 caption and the opening of Section 3 now state this division.
No. Most of the improvement comes from the record, and we measured this in three ways.
The full results, including the step-by-step table and the table of component replacements, are in our responses to Reviewer Qqob (comments 2 and 3).
Each experiment has one role, and the revised Section 4 now opens with a paragraph that gives this map:
Section 4 is now organized around the claim. It has two parts. Section 4.1 tests the claim (RQ1 to RQ3). Section 4.2 gives its scope (RQ4 and RQ5). We kept these two scope analyses in the main text, in one paragraph each, because they state the limits of the claim: comparisons depend on the reader, and accuracy drops when a stream changes scene. Construction variants, results per question type, cost and failure analyses are in the appendices.
The revised main text can be read without the appendices.
All changes are highlighted in yellow in the revised PDF.