- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
TinkerCube combines language, multi-view geometry, and image generation for spatial QA, geometry prediction, and novel-view synthesis.
Critical strengths
- The spatial QA gains are convincing, and the matched-data controls help rule out extra training data as the main explanation.
- The writing is clear and the logic is easy to follow.
- The component ablations support the proposed language–geometry interfaces.
Critical weaknesses
-
Unclear whether the geometry baselines receive the same target-view information. Without this, the comparison is hard to judge.
-
The paper does not show that generated views improve reasoning or reconstruction. View-synthesis gains over MetaView are small and mixed.
-
The overall framework is overcomplicated and which part is initialized with pretrained model, how much is benifited from this pretraining?
Questions for authors
- What inputs does each geometry baseline receive? Can you compare them under the same input setting?
- Does feeding generated views back into the model can improve QA or even reconstruction?
3.Did the generated images really help with understanding? Creating seemingly reasonable images does not mean that the true hidden space has been restored; the paper does not directly prove that after filling in the generated images, the question-answering or reconstruction performance improves.
4 comments
Response to Reviewer 1qNJ (Part 2)
(Continuing from the previous part)
Accuracy and Completion improve continuously on both datasets as generated views are added. The additional views improve local point cloud quality and cover space that is insufficiently observed by the original references. Appendix I.5.2 provides the complete protocol and quantitative results, while Appendix A.2, Figures 7 and 8, shows progressive point cloud expansion. These experiments directly demonstrate that generated views support spatial reasoning and improve both the accuracy and completeness of three dimensional reconstruction.
W2: Comparison with MetaView
Thank you for asking about this comparison. MetaView is a recent state of the art NVS specialist at ECCV 2026 with about 28B parameters, whereas the TinkerCube expert responsible for image generation uses only 7B. With this more compact generation component, TinkerCube achieves comparable NVS performance and higher PSNR on DL3DV and RealEstate10K, with 16.218 versus 16.190 and 19.419 versus 19.339, respectively. It also achieves higher SSIM on RealEstate10K, with 0.682 versus 0.677.
Our primary focus is the unified modeling of spatial reasoning, three dimensional reconstruction, and NVS, together with the interactions among these capabilities. We include MetaView to present the generation ability of our unified model against a strong specialist reference. The results show that TinkerCube supports all three spatial tasks while its 7B generation expert retains synthesis quality comparable to a leading specialist model. They also support the value of coordinating geometry and semantic information for NVS.
W3: Architecture complexity, initialization, and benefits of our design
Thank you for asking about the architecture and the benefits of pretraining. Although the complete framework may appear complex, the three experts have clear and complementary roles. BAGEL initializes the understanding and generation experts with basic multimodal understanding and image generation capabilities. VGGT Ω initializes the geometry expert with basic three dimensional geometry capabilities. These pretrained weights provide a reliable general starting point and a stable optimization platform for subsequent spatial interaction and capability expansion.
On this foundation, we introduce interaction structures designed for spatial tasks. GAR brings camera and cross view geometry into spatial reasoning. LCG uses motion and content routing and target view modulation to convert semantic instructions into camera and geometry predictions. RGG constrains image generation through geometric rendering, coverage masks, and camera rays. Together with progressive training across three stages, these designs extend the basic pretrained abilities into coordinated spatial perception, modeling, and generation.
The matched results separate the general foundation supplied by pretraining from the gains produced by our design. The table reports actual scores, with gains over the corresponding baseline in parentheses:
| Setting | SPAR | ViewSpatial | VSI |
|---|---|---|---|
| BAGEL | 39.3 | 42.0 | 26.7 |
| Full TinkerCube | 65.6 (+26.3) | 56.2 (+14.2) | 61.4 (+34.7) |
| TinkerCube S1 with GAR versus BAGEL plus S1 | 60.4 (+4.6) | 52.7 (+3.8) | 55.2 (+3.6) |
The BAGEL scores show that pretraining provides a reusable vision and language foundation, while leaving substantial room for specialized spatial improvement. The GAR comparison uses identical initialization, S1 data, and training budget, while the fusion comparison uses the same pretrained components, data, and training budget across all three stages. On geometry, TinkerCube reduces Sintel camera ATE by 24.6% relative to VGGT Ω and improves AUC@30 by 2.4 and 3.8 points on Sintel and 7 Scenes. These results show that pretraining mainly supplies general abilities and training efficiency, while the substantial spatial gains arise from our interaction interfaces, spatial adaptation, and progressive coordinated optimization.
We hope these additions address your questions and would be happy to discuss any remaining concerns. If these clarifications strengthen your confidence in our work, we would be grateful if you could consider whether a slightly higher score might be appropriate. Thank you again for your time, careful consideration, and constructive suggestions, which have helped us improve the paper.
Follow Up to Reviewer 1qNJ
Dear Reviewer 1qNJ,
We apologize for following up again during this busy period. Thank you sincerely for your careful review and thoughtful suggestions. Your feedback has given us valuable insights and helped us improve our work, and we have learned a great deal from this exchange.
When you have a chance, we would be grateful to hear whether our responses and additional experiments have addressed your concerns. We greatly value the opportunity to learn from your perspective and will make every effort to address any remaining questions thoroughly. We would be happy to provide further explanations and continue an open and constructive discussion.
If you feel that our additional experiments and clarifications have addressed your concerns or strengthened your confidence in the paper, we would also be very grateful if you could consider whether a slightly higher score might be appropriate.
It has been a pleasure to exchange ideas with you. We look forward to hearing from you whenever convenient and would sincerely appreciate any further feedback. Thank you again for your patience, time, and care in helping us improve our work.
With sincere regards,
The Authors
Follow Up on Our Rebuttal
Dear Reviewer 1qNJ,
We apologize for following up once more. As the discussion period draws to a close, we would appreciate a brief update on whether our responses and additional experiments have addressed your concerns. We would be happy to clarify any remaining questions.
We understand that scores may still be updated after the author reviewer discussion period ends. If our additions have resolved your concerns or strengthened your confidence in the paper, we would be very grateful if, when convenient, you could consider whether an upward score adjustment would be warranted.
Thank you sincerely for your time and consideration.
With sincere regards,
The Authors
Response to Reviewer 1qNJ (Part 1)
Thank you for recognizing our gains in spatial QA, matched data controls, clear presentation, and language and geometry interface ablations. In response to your key questions, we add analyses of input fairness, generation feedback, and pretraining benefits. We appreciate the opportunity to learn from and discuss your feedback.
W1 and Q1: Target view information and fairness of geometry comparisons
Thank you for asking about the fairness of the geometry comparisons. Tables 3, 4, and 5 follow the official RGB input setting of the geometry baselines, and every method receives the same shared RGB observations. To support multimodal interaction and the integration of three dimensional geometric features, TinkerCube can also receive a target view condition. During training, we apply dropout to this condition so that the model can predict geometry when the target condition is empty. Therefore, in the baseline comparisons, we set the target view condition to empty and use the same input information as the baselines. Appendix G now states this evaluation setting explicitly.
To further analyze the role of the target view condition, we add target view information to the same RGB observations. ETH3D Accuracy and Completion decrease by 0.022 and 0.039 m, while Sintel AUC@3 and AUC@30 increase by 3.9 and 3.6 points:
These results show that TinkerCube already provides competitive geometry prediction under shared inputs and can further improve prediction accuracy and completeness by using richer target conditions.
W2, Q2, and Q3: Feedback from generated views to reasoning and reconstruction
Thank you for asking whether generated images genuinely improve understanding and reconstruction. Our original experiments mainly examine how three dimensional geometry supports spatial reasoning and NVS. To further test feedback in the reverse direction, we add experiments on spatial reasoning and three dimensional reconstruction with generated views.
Spatial reasoning with generated views. We use generated images as alternative visual expressions of the available observations and learned structural priors, rather than as true recovery of hidden space. More suitable viewpoints can reduce viewpoint conversion, present cross image object relations within one view, and provide more complete appearance cues for partially visible objects. Specifically, we select five intermediate viewpoints that balance scene coverage and joint visibility of separated regions, generate their images, and combine them with the original inputs to answer the same questions.
Generated feedback improves ViewSpatial by 1.6 points, including gains of 3.5 and 2.8 points on Person SSRD and Camera Relation, and improves SPAR and ScanQA by 0.9 and 1.1 points. These results show that generated views help the model use existing spatial relation evidence more effectively. Effective feedback also depends on suitable camera selection. Appendix I.5.1 provides the complete selection protocol and visual cases showing how intermediate views reduce occlusion, integrate cross image relations, and simplify reference frame conversion.
Three dimensional reconstruction with generated views. Generated feedback has two roles in reconstruction: supplying transition observations between reference views to refine local geometry, and covering insufficiently observed regions to expand the scene point cloud. We sample five real reference images from a scene window, select three intermediate viewpoints according to missing projected coverage, generate their images, and evaluate reconstruction after adding each view. Every setting is scored against the same real geometry from the scene window. R and G denote real and generated images, while C and A denote Completion and Accuracy in meters, both lower is better.