- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper revisits Point In-Context Learning (Point ICL) and argues that existing protocols may conflate true task inference with task recognition, since training and evaluation typically share the same predefined task families. To better evaluate transfer to unseen transformation processes, the authors introduce PIC-Bench, which contains five structured point cloud restoration tasks, and propose TETRIS, a self-supervised framework for learning task representations from unlabeled clean point clouds. TETRIS constructs training episodes by composing parameterized atomic point-set operators online and applying the same transformation to different objects, encouraging the model to capture transformation-related information rather than object-specific geometry. On PIC-Bench, TETRIS pretrained on OpenShape achieves an overall Chamfer distance of 8.7, substantially outperforming DeformPIC* (31.6), which uses the same improved backbone but follows the conventional supervised Point ICL training protocol. TETRIS pretraining also improves downstream data efficiency on ShapeNet-In-Context, especially under limited supervision.
Critical strengths
-
The paper identifies an important evaluation issue in Point ICL. The distinction between task recognition and genuine task inference is well motivated. The paper correctly notes that changing the object domain does not necessarily test generalization to new transformation processes.
-
PIC-Bench provides a more structured evaluation of transformation transfer. The benchmark covers sensor noise, clutter, multi-view misalignment, partial observations, and physical occlusion, with multiple subtypes and difficulty levels. This is more informative than evaluating only simple random perturbations.
-
The self-supervised design of TETRIS is well aligned with its objective. Applying the same transformation composition to different support and query objects encourages the learned representation to capture shared transformation information rather than memorizing support geometry. The formulation is also appealing because it does not require task labels or downstream training pairs.
Critical weaknesses
-
The “unseen task/process” claim needs to be defined more precisely.
Several PIC-Bench degradations appear conceptually related to the atomic operators used during TETRIS pretraining, including point addition/removal, rotation, jittering, and missing geometry. It is therefore unclear whether the benchmark primarily evaluates unseen operators, unseen compositions, parameter extrapolation, or more structured realizations of previously seen operators. If the test processes are largely composed of familiar primitive transformations, the claims should be framed more carefully as compositional or structured transfer rather than broad generalization to unseen processes. -
The connection between PIC-Bench and real acquisition failures is not sufficiently validated.
Many degradations are synthetically parameterized by the authors, such as range bias, scanline wobble, occlusion patterns, and multi-view pose errors. While these are plausible, the paper does not provide comparisons with real sensor artifacts, real scanning failures, or established real-world corrupted point cloud datasets. This makes it difficult to assess how representative the benchmark is of practical 3D acquisition scenarios. -
The method may depend strongly on the coverage of the atomic operator library.
TETRIS is pretrained using addition, removal, rotation, scaling, and jittering, while the benchmark tasks involve related corruption factors. The current ablations mainly vary composition length, but do not study operator removal, alternative operator distributions, or test processes that are clearly outside the pretraining operator family. As a result, it is difficult to determine how much of the gain comes from learning a general task representation versus covering the key structures of the test degradations during pretraining.
Questions for authors
-
Could the authors clarify the relationship between each PIC-Bench task and the atomic operators used during TETRIS pretraining? In particular, which aspects are genuinely unseen at test time: operator type, composition, parameter range, or structured process?
-
How were the PIC-Bench degradation processes and severity ranges chosen? Were they calibrated using real sensor data, real scanning failures, or domain expertise? Validation on real corrupted point clouds, or at least a comparison between synthetic and real degradations, would strengthen the benchmark.
-
How sensitive is TETRIS to the design of the atomic operator library? For example, what happens if point addition, removal, rotation/scaling, or jittering is removed during pretraining, or if different parameter distributions are used? Such experiments would help separate general task-representation learning from coverage of the benchmark degradations.
2 comments
3. Sensitivity to the operator library. Following the reviewer’s suggestion, we added four operator-removal ablations on ShapeNet. All variants use the same architecture and training settings, including 300 epochs, with only the available operators changed. Removing Add or Drop excludes both global and local variants. We evaluate all models on the complete 10,000-episode PIC-Bench test set.
Operator-library ablation (CD ↓).
| Setting | SSD | SCR | MVM | RPC | POR | Avg. |
|---|---|---|---|---|---|---|
| Full library | 5.43 | 9.09 | 10.35 | 6.76 | 18.09 | 9.94 |
| w/o Add | 6.18 | 22.66 | 12.07 | 5.95 | 21.94 | 13.76 |
| w/o Drop | 5.55 | 9.12 | 11.01 | 27.85 | 27.82 | 16.27 |
| w/o Rotate/Scale | 5.69 | 11.15 | 11.87 | 5.90 | 15.27 | 9.98 |
| w/o Jitter | 6.11 | 10.31 | 10.65 | 6.78 | 17.51 | 10.27 |
The full operator library achieves the lowest average CD, while reduced libraries show different performance profiles across tasks. These results suggest that the atomic operators provide complementary training signals. Their joint use broadens the range of transformation compositions encountered during pretraining and supports transfer across the diverse structured processes in PIC-Bench.
We thank the reviewer for the constructive feedback.
1. Meaning of unseen processes. We would like to clarify that “unseen” refers to the complete degradation process. TETRIS constructs training episodes from a shared library of seven atomic operators: global and local point addition, global and local point removal, rotation, scaling, and jittering. These operators introduce uniform outliers or Gaussian clusters, remove points randomly or directionally, rotate or scale the entire point cloud, and apply independent Gaussian perturbations. For each episode, we sample the operator identities, order, and parameters online and apply the same composition to different support and query objects.
PIC-Bench uses independently defined generators based on sensor, scene, visibility, and multi-view mechanisms. These generators introduce specific observation rules and spatial dependencies, and none is used to construct the pretraining episodes. The five processes are:
Structured Sensor Denoising (SSD) models sensor-dependent distortions through range bias fields, depth quantization, scanline wobble, and multipath ghost returns. Range bias varies across the observed surface, quantization creates depth bands, scanline wobble introduces periodic displacement, and ghost returns form displaced surfaces. The resulting distortions depend on the sensor configuration and object geometry.
Scene Clutter Removal (SCR) constructs observations containing the target object and surrounding clutter. Its subtypes introduce supporting planes, fragments of other objects, points extending beyond the target boundary, or mixtures of these sources. The clutter has coherent surface structure and a spatial relationship to the target, requiring the model to recover the target geometry from the combined observation.
Multi-View Misalignment (MVM) generates partial scans from multiple viewpoints and fuses them after introducing pose errors. Its subtypes cover pairwise pose errors, accumulated drift across scans, a single misaligned view, and limited overlap between views. The fused observation contains inconsistent geometry determined by the individual scan poses and their visible regions.
Rendered Partial Completion (RPC) constructs partial observations using viewpoint-dependent visibility. Its subtypes include single-view observations, sparse multi-view coverage, additional thinning of observed points, and depth-dependent density variation. The observed geometry depends on the viewpoints, surface visibility, and sampling pattern, while the reconstruction target is the complete object.
Physical Occlusion Recovery (POR) places foreground objects or planar screens between the sensor and the target and computes visibility in the combined scene. The input contains both visible target regions and foreground interference. Its subtypes vary the occluder geometry, number, and proximity to the target, producing different patterns of missing geometry and obstruction.
The distinction is therefore between online compositions of atomic point-set operations and structured processes governed by sensor, scene, visibility, and multi-view rules. Elementary corruption factors and numerical parameter ranges may overlap; PIC-Bench evaluates whether learning from the former transfers to the latter.
We will add precise definitions of all five task generators and detailed parameter settings to the appendix, including subtype-specific generation rules, visibility and occlusion procedures, and numerical ranges for each difficulty level. We will also clarify their distinction from the atomic pretraining operators in the main text.
2. Acquisition mechanisms and severity ranges. PIC-Bench uses synthetic models motivated by sensor errors, scene interference, partial visibility, and multi-view acquisition. We define five severity levels on normalized point clouds by increasing displacement, clutter, occlusion, and pose errors, or decreasing visible coverage. These ranges provide controlled variation in degradation severity and were not calibrated against real sensor measurements. We will state this design rationale alongside the detailed generator specifications in the appendix.