- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper aims at the problem of reconstruction of partial visible objects. In contrast to existing work that mainly deals with partial visibility through occlusion, in this work the goal is to handle objects that are partially visible due to the frustum. This of course shares lot's of properties as it can be seen as a partial occlusion where the occlusion boundary is known. The core trick in this paper is to only complete the objects partially visible in the scene, and not hallucinate beyond. The pipeline is straight forward, an image with depth is fed, Dino features are extracted, a bounding box location is predicted and then a unet performs completion. Training is performed fully supervised and a low res voxelbased representation is chosen
Critical strengths
I like the posed task and the approach to only complete the parts that are partially visible in the scene. There is extensive experimental evaluation.
Critical weaknesses
- VisHall3D pointed out as closest in related work and seems very similar. the contribution is phrased as collapsing this into a single stage - it however is not compared or ablated against this model
- The paper is hard to read, and this already starts with the abstract which introduces quite some jargon which is not common when the paper was not read (e.g. DINO-decorated 3D seed or scene-fitted box). When hybrid is used the first time in line 30 it is unclear what are the components? the related work section is more a list than supported with a story
- the method seems strongly limited by the training data which is 3D. several works have shown that solving parts of the problem in 2D might ease it through the massive better availability of training data. I'm surprised that the image is not outpainted before reconstruction which would serve as a good baseline.
- the dataset chosen for zeroshot generalization is collected by the same lab as the training data and has therefore strong hardware and data modality overlap
- the core contribution is stated as defining a task and one particular solution. When a new task is proposed I would hope to see multiple approaches or variants
minor comments:
- Introduction is missing citations (e.g. "by methods that synthesize an entire room from one image")
- Figure 3: it would help a lot if the visible parts could be highlighted somehow and if the poses of the images would be closer (especially first and last one are 90 degrees of, which took me a while to parse).
- the name of the method seed2sene is misleading, as the core trick from my perspective is not to actually complete the scene, but only the partiallyvisible parts
- figures are pixelgraphics instead of vector graphics
Questions for authors
It is unclear to me, how the crops of the views during training and during testing where performed (sample at random is the only description I found). I would like to hear in the rebuttal what the distribution of the crops in both phases were (perhaps I just missed that in the paper).