- Rating
- 2
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates Gestalt-like perceptual completion in Masked Autoencoders (MAEs). The authors use controlled visual stimuli to study contour continuation, symmetry, and boundary completion. They also compare MAEs continually pretrained on natural images and texform images. The results show that training data affects the preference for local and global completion. Finally, the authors analyze the contribution of decoder attention heads to these behaviors.
Critical strengths
S1. Well-designed controlled experiments. The authors use controlled stimuli to study perceptual completion. Changing distant visual elements while keeping local evidence fixed is a useful experimental design.
S2. Interesting observations on training data. The comparison between natural-image and texform adaptation shows clear changes in completion behavior. The experiments provide quantitative results for boundary reconstruction and local-global preferences.
Critical weaknesses
W1. Limited novelty compared with existing work. Several studies have already investigated Gestalt-like behavior in neural networks. Li et al. (2025) studied Gestalt organization in self-supervised vision models, including MAEs. Kim et al. (2021) examined how natural image statistics affect Gestalt closure. Recent studies have also analyzed attention heads related to perceptual organization.The paper does not clearly explain its new findings beyond these studies. The novelty of the proposed analysis remains unclear.
W2. Insufficient evidence for the proposed mechanism. Texform adaptation changes more than global image structure. It may also affect general reconstruction quality. Therefore, the observed changes may not be caused only by weaker global perceptual priors.
Questions for authors
Q1. Novelty compared with prior work.
Several studies have already investigated Gestalt-like perception in neural networks. Could the authors clearly explain the main differences and novel contributions compared with the following works?
- From Local Cues to Global Percepts: Emergent Gestalt Organization in Self-Supervised Vision Models (2025).
- Neural Networks Trained on Natural Scenes Exhibit Gestalt Closure (2021).
- Does Resistance to Style-Transfer Equal Global Shape Bias? Measuring Network Sensitivity to Global Shape Configuration (2023).
- Locating and Editing Figure-Ground Organization in Vision Transformers (2026).
- I Walk the Line: Examining the Role of Gestalt Continuity in Object Binding for Vision Transformers (2026).
In particular, what new insights do the texform adaptation and attention-head analyses provide beyond these existing studies?
Q2. Training data. How can the authors confirm that the changes after texform adaptation are caused by disrupted global structure rather than reduced reconstruction quality?
Q3. Do the identified attention heads specifically support Gestalt-like completion, or are they also important for general image reconstruction? Could the authors compare their effects on perceptual completion and ordinary reconstruction tasks?
I'm willing to raise my score to 3 points after you provide a convincing answer to my question.
2 comments
3. Are the identified heads specifically involved in Gestalt completion?
We thank the reviewer for suggesting a comparison with ordinary reconstruction. We have added this control in Appendix §5.9, Figure 15b. We individually ablated all 128 decoder heads on 400 held-out ImageNet validation images. Each image provided two nonoverlapping 33-patch gaps: one crossing an automatically detected straight boundary and one at a random location. The control shows that heads identified through Kanizsa completion also contribute to ordinary masked reconstruction, without clear evidence of a larger effect for boundary-crossing gaps. However, the overall head-ablation profiles differ between natural-image reconstruction and the artificial perceptual tasks, suggesting that the relative contributions of decoder heads depend on the completion setting.
Our perceptual-task interventions provide complementary evidence. For contour completion, heads are ranked through bidirectional activation replacement on 24 discovery instances, with the ranking fixed before ablation on 40 held-out instances. Ablating the top 16 heads increases target-patch MSE from 0.05596 to 0.07734. Cross-task comparisons further show that the most influential heads differ across contour continuation, Kanizsa completion, and local–global preference.
Together, these results support partially distinct head contributions across completion behaviors, alongside involvement in ordinary reconstruction. We therefore describe these heads as contributing to Gestalt-like completion, without claiming exclusive specialization. The diverse profile between the natural-image reconstruction and the gestalt-like perceptual completion also motivates further investigation into how computations learned through natural-image reconstruction generalize to Gestalt-like completion in artificial displays.
Thank you for recognizing the controlled stimulus design and the training-data results. We agree that our contribution should be distinguished more clearly from earlier work on learned Gestalt-like organization.
1. What advances beyond prior work?
Our contribution concerns which missing structure an MAE generates when local and global principles disagree, and how that preference changes with visual experience. We combine these cue-conflict tests with interventions on distant context under fixed local evidence and causal tests of decoder contributions.
Li et al. (2025) and Kim et al. (2021): These studies establish Gestalt-like responses through internal activations, representational similarity, and global-structure sensitivity. We examine the missing structures produced by the MAE’s reconstruction process. Manipulating distant elements while preserving nearby evidence tests their influence on the predicted pixels; cue-conflict stimuli then quantify whether reconstruction more closely follows local continuation or global symmetry.
Wen et al. (2023) investigate sensitivity to global image configuration and introduce training that explicitly distinguishes intact from disrupted structures. We extend this question to perceptual completion: when local continuation and global symmetry predict different missing shapes, which principle guides reconstruction? Under the same masked-reconstruction objective, natural-image versus texform adaptation changes this preference, reversing the average global preference for cross stimuli. Our contribution therefore concerns how training experience changes the competing structural constraints expressed in generated completions.
Arnold and Gröbner (2026) and Tartaglini and Lepori (2026) identify heads supporting BEiT’s convex-completion preference and continuity-based object binding in vision transformers, including MAEs, respectively. We extend this analysis to MAE decoder computation, using bidirectional activation replacement followed by ablation on held-out contour stimuli. We further compare individual-head effects across contour continuation, Kanizsa completion, and local–global preference. Heads ranked highest for contour continuation overlap little with those most influential for Kanizsa completion or local–global preference, suggesting that different Gestalt-like completion behaviors rely on partially distinct sets of decoder heads.
2. Could texform adaptation simply reduce reconstruction quality? Both adaptation conditions start from the same checkpoint and use matched sets of 100,000 natural images or their texform counterparts for 500 epochs. Evaluation uses identical inputs and masks.
We have added non-conflict reconstruction examples in Appendix §5.10, Figure 16. In these examples, the natural-image- and texform-adapted models produce qualitatively similar completions, and the texform-adapted model successfully reconstructs missing contours following good continuation. These examples show that local contour completion remains functional after texform adaptation.
When local and global cues conflict, however, adaptation systematically changes the preferred completion. Table 2 shows that texform adaptation improves agreement with the local reference while reducing agreement with the global reference:
Together, successful non-conflict completion and a systematic shift toward local alternatives under cue conflict argue against a uniform loss of contour-reconstruction ability. They support a change in the relative influence of local continuation and global shape constraints. The added examples are qualitative and do not establish equal reconstruction quality across natural images. Nevertheless, they strengthen the interpretation that texform adaptation changes completion preferences, consistent with coherent training-image structure helping sustain globally organized completion.