- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors introduce DORIC, a framework that leverages LLMs, alongside prior work (Digital Gene), to generate programmatic descriptions of objects for geometric understanding and physical interaction. The paper describes the proposed system and evaluates it's effectiveness.
Critical strengths
Motivation: The problem is well-defined and articulated. The preliminary and introductory sections highlight the motivation and challenges well, making the rest of the paper follow nicely as a logical conclusion.
Straight-forward: The proposed system is intuitive and straight forward. Conceptually it is quite simple, which makes the results particularly impressive and the provided ablations shed insight into the importance of each component.
Clear writing: The writing is clear and easy to follow. My only issue is with Figure 2 (see Weaknesses). Otherwise, the figures are clear and helpful.
Critical weaknesses
Extensibility: The proposed method appears quite rigid to change. Specifically, the authors define a list of parts and concept templates (L229 - 263 concept template). Then, for each concept template a "specialized parameter estimation module is trained" (L229). This training requires the object concept to be represented in the ConceptFactory dataset. Thus, one can imagine that given the set of 263 templates, one can construct examples that fall out of distribution of these templates. For these objects/scenes, the method is definitionally unable to capture these objects. While 263 is a large number, the authors need to do more to convince the reader that this set is sufficient to capture a significant distribution of objects (including the weird and irregular geometries we encounter in the real world!). If it cannot, that is also ok, but the authors should explicitly discuss this limitation and show cases where objects fall OOD.
Ablation on concept templates: Slightly related to the previous point, it would be interesting to investigate the ability of DORIC to represent objects when there are fewer concept templates to compose. Specifically, are there some concept templates that are crucial to accurate modeling? Is the DORIC pipeline & the LLMs it uses able to compose templates in creative ways when the bespoke "percect" template is missing? This analysis would be valuable and insightful to establish the robustness of the approach.
Figure 2: This figure is difficult to follow. There are many arrows, an exhaustive amount of text, and tiny sub-figures. These things make the logical flow hard to keep up with. I recommend the authors to simplify this figure with a schematic (e.g. showing code snippets or pseudocode) and make the logical flow of the figure more salient. I appreciate the attention to detail, but a full working example can go in the Supplementary, the purpose of this figure should be to give an intuitive understanding of your method.
Questions for authors
Please see Weaknesses.