- Rating
- 2
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces PixelDec, a conditional flow-matching framework for generating superquadric decompositions from single-view observations. By distilling knowledge from a SuperFlex teacher that operates on complete point clouds, PixelDec aims to produce compact geometric representations while inferring unobserved object geometry. The authors evaluate the proposed method on ShapeNet, ASE, and TableVerse, examining both reconstruction quality and computational efficiency. The paper further explores its potential applications in downstream robotic tasks, including grasping, motion planning, and VLM-guided manipulation.
Critical strengths
- The paper presents a comprehensive generative pipeline for superquadric scene decomposition from single-view observations, aiming to produce compact geometric representations while inferring unobserved geometry.
- The method thoughtfully addresses the heterogeneous nature of superquadric parameters by introducing tailored flow-matching formulations for both continuous geometric parameters and discrete existence variables.
- The downstream table-decluttering experiments show encouraging improvements in grasp success rates, while the VLM-guided application provides an interesting illustration of how the learned representation can facilitate planning for physical interactions. I also appreciate the supplementary real-world demonstrations, which further highlight the practical potential of the proposed approach.
Critical weaknesses
- I would appreciate a clearer discussion of how the proposed algorithmic contributions differ from and extend prior work:
- Prior work [1] has already explored generative modeling in the superquadric parameter space. While this paper extends this direction to reconstruction from partial observations, I wonder if the authors could further clarify the methodological contributions beyond this task extension, as the additional algorithmic novelty seems somewhat limited from my understanding.
- PixelDec is trained under the supervision of a frozen SuperFlex teacher that operates on complete point clouds. While the improvements over partial-input baselines provide encouraging evidence of its completion capability, I wonder whether these results necessarily imply an improvement in decomposition quality under complete observations. From my understanding, the main contribution appears to be more closely related to conditional completion rather than advancing the underlying decomposition capability itself. It would be helpful if the authors could further clarify this distinction.
- I appreciate the point-cloud-only comparison on ShapeNet, which helps ensure input fairness. However, the robotics evaluation additionally involves RGB conditioning and selection among multiple generated samples. I wonder if the authors could clarify how much of the improvement stems from generative modeling itself rather than these additional factors. Taken together, the results demonstrate useful practical benefits, while leaving some uncertainty about the extent of the independent algorithmic advance.
- Further analysis of the sources of improvement would be helpful. The ablation studies provide useful insights into image conditioning, existence modeling, and sampling steps. However, I wonder if the authors could further clarify a few remaining questions, such as:
- A controlled comparison with deterministic regression under similar architectural settings, conditioning, and teacher supervision would help better understand the specific benefits of generative modeling.
- A controlled evaluation under varying degrees of input occlusion or truncation would help better understand the scenarios in which generative modeling is most beneficial.
- The evaluation of computational efficiency could benefit from further clarification and more comprehensive reporting.
- The meanings of and in Tab.2 are unclear to me. It would be helpful if the authors could specify the hardware used for runtime evaluation to improve the interpretability and reproducibility of the results.
- The single-image pipeline relies on instance segmentation and point-map prediction using SAM3 and MoGe2. From my understanding, the runtime reported in Tab. 2 may not include these preprocessing costs, while the robotics timing starts from already segmented point clouds. I wonder if the authors could clarify the end-to-end latency, including preprocessing, to better support the real-time claim in Sec. 4.3.
[1] Zhiyang Liu et al. Rethinking 3D Shape Generation: Diffusion over Superquadrics. In ICML, 2026.
Questions for authors
- It would be helpful to clarify the methodological novelty and isolate the benefits of generative modeling.
- Ablations comparing deterministic regression with generative modeling, alongside evaluations across different levels of occlusion or truncation, could help clarify the benefits of generative modeling.
- Clarifying the memory metrics, evaluation hardware, and end-to-end computational costs would strengthen the efficiency analysis.
- I wonder if Fig. 7 could be presented more clearly, as I find it somewhat difficult to identify the attention patterns between semantically similar or structurally dependent parts discussed in the paper.
- It would be helpful if the authors could include some generated 3D assets (e.g., .glb files) from both the proposed method and the baselines in the supplementary material to facilitate qualitative comparison.
6 comments
2. Benefit from Generative Modeling, RGB/DINO features, and sample selection
The reviewer asks for a comparison of deterministic regression with generative modeling. We trained a deterministic version of PixelDec (Deterministic student) and we report qualitative results in Fig.18 (revised paper) and quantitative in the table below. These results overall show that the impact of using a generative approach is more significant than mere RGB features. We thank the reviewer for the inspiration for these experiments and we will include them in the revised version of the paper.
| Method | RGB | Gen. | IoU ↑ | L1 ↓ | L2 ↓ | P-FID ↓ | P-KID ↓ | # Prim. |
|---|---|---|---|---|---|---|---|---|
| SuperFlex | ✗ | ✗ | 0.463 | 2.34 | 0.15 | 12.2 | 28.6 | 4.91 |
| Deterministic Student | ✓ | ✗ | 0.447 | 2.59 | 0.15 | 3.92 | 6.40 | 4.35 |
| PixelDec | ✗ | ✓ | 0.603 | 1.70 | 0.08 | 0.88 | 0.13 | 5.58 |
| PixelDec | ✓ | ✓ | 0.622 | 1.62 | 0.06 | 0.86 | 0.06 | 5.59 |
In robotic experiments we select the best sample among multiple generations. In practice, we select the sample with lowest point-to-surface distance (P→SQ, computed on observed points). The P→SQ metric unsurpirsingly improves when compared to the average one (see results below), while other metrics do not change substantially. We think the sample selection is not crucial to our method.
| PixelDec sampling | IoU ↑ | Chamfer-L1 ×100 ↓ | P→SQ ↓ |
|---|---|---|---|
| Average over 10 draws | 0.500 | 5.80 | 2.55 |
| Draw with lowest P→SQ | 0.510 | 5.52 | 1.89 |
3. Evaluations across different levels of occlusion or truncation.
The reviewer is curious of how our method performs under different levels of occlusion. We report qualitative results in Fig.19 and quantitative in Fig. 20 of the updated paper. They show that our PixelDec generates good decomposition also for strongly occluded objects while this is not the case for baselines. Notice that in the figure we also include the new Deterministic Student related to the point above.
4. Memory, hardware, and computational costs.
The reviewer asks for details on our evaluation setup around memory usage, hardware and computation cost of all method components.
- In Table 2, Mem(_m) denotes GPU memory occupied by model weights, while Mem(_s) denotes additional GPU memory required for single-object inference.
- Runtimes in the main paper are measured on an NVIDIA A100 (80 GB) with models already loaded, excluding SAM3 instance segmentation and MoGe2 point-map prediction, which is shared among all the methods. Preprocessing takes 0.430 s (SAM3: 0.367 s with batched prompts; MoGe2: 0.063 s). We include runtimes for SAM3, MoGe2 in Fig. 17 (left) in the updated paper.
- Fig. 17 (middle and right) also provides clearer runtimes comparison of different methods on Big Bang Theory scene (middle) and in function of number of objects (right), computed on an RTX 4090. SAM3D and ShapeR runtime grows linearly with the number of objects, as their inference already saturates GPU compute. In contrast, PixelDec reconstructs all objects in a single batch, maintaining nearly constant runtime as the number of objects increases.
5. Does PixelDec improve decomposition quality of SuperFlex under complete observations?
SuperFlex is the teacher which defines the upper bound of the decomposition quality of PixelDec. PixelDec itself does claim contributions with regard to decomposition quality.
Q5. Provide GLB files. Thank you for the suggestion. We added an interactive HTML viewer to the supplementary material to compare 3D reconstructions from PixelDec and the baselines side by side. After extracting the supplementary ZIP, open interactive_html_viewer/index.html in a browser. Standalone .glb files for PixelDec and the baselines are included in interactive_html_viewer/assets/. Please let us know if you have any trouble opening the viewer or accessing the visualizations.
We thank the reviewer for their thoughtful and honest feedback. Below, we address the individual questions with more in-depth explanations. We are happy to provide further explanations and additional results if needed.
1. Comparison to Prior Work The reviewer asks how our approach differs from “Rethinking 3D Shape Generation: Diffusion over Superquadrics” (DoSs) [ICML’26]. We thank the reviewer for pointing us to this work, which we will discuss in the revised paper. Both methods share the high-level idea of generative modeling directly in superquadric parameter space. However, they follow different algorithmic approaches, and PixelDec operates in a substantially more challenging setting, enabled by several methodological contributions. We discuss these differences below.
Taken together, PixelDec differs from DoSs both in its setting (class-agnostic, conditional, pixel-aligned generation) and in its method (deformable superquadrics and joint continuous–discrete flow). As a result, PixelDec reconstructs complex real-world scenes, runs in working robotic systems, and matches or outperforms state-of-the-art 3D generative methods at a fraction of their runtime and memory cost, whereas DoSs only demonstrates generation of three object categories in canonical pose.