- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes VisFlow, a flow matching method to perform Visibility Characterization, Visibility Reconstruction and Visibility Recognition. The idea of VisFlow is to encode the signed distance function of a polygon into a latent space and learn a latent representation in which stages of polygon formation follow approximately linear trajectories. So also intermediate states along the trajectories that are polygon evolutions . The trajectories are obtained by applying grassfire flow to progressively collapse every polygon to a triangle and then reversing the resulting trajectory. During sampling they draw an initial triangle and evolve its latent representation to generate a polygon condition on the target visibility graph.
VisFlow consists of three main components:
- The Visibility Prediction Network: this part provides a differentiable approximation of polygon visibility. It is trained using binary cross entropy on geometric visibility predicated and it is later used to provide visibility supervision.
- SDF Latent Generator: this module is an encoder decoder architecture that represents polygon using SDF latents. It is trained using reconstruction, visibility and alignment and regularization losses.
- Flow Netwrok: this part models polygon generation from the initial triangle latent to the target polygon latent, conditioned on the target visibility graph. The three components are trained sequentially: first the Visibility Prediction Network, then the SDF Latent Generator, and finally the Flow Network, keeping the previously trained components frozen. The authors also introduce a new synthetic dataset containing 10,000 polygons. The dataset is designed to cover more complex concavities than previous datasets, including VisDiff. The test set contains unseen visibility graphs to evaluate generalization to new visibility structures.
Critical strengths
- The experimental results are promising, especially for visibility reconstruction and characterization.
- The proposed method including the combination of latent representations, grassfire trajectories, and flow matching is interesting and within the scope of the conference.
- The new dataset includes more complex polygon geometries and visibility structures than previous benchmarks.
Critical weaknesses
- The authors claim that the method is interpretable, but this property is not clearly explained later.
- The methodology section is not very clear, especially regarding the interaction between the three components and the reader has to read it multiple times in order to understand it, also the reader is required to check the appendix in order to understand many essential part of the paper such as the architectures and the dataset. In particular on this last point, the new dataset is presented as a contribution in the introduction, but its construction and main characteristics are only discussed in the appendix.
- The contribution of each architectural component is not sufficiently investigated.
- None of the statement of the Introduction is supported by references (there are no citations at all in the introduction).
Questions for authors
- How much do visibility supervision, latent alignment, and the flow-based generative model contribute to the final performance compared to simpler alternatives?
5 comments
I thank the author for their response.
About the change in the presentation it would have been nice to already see some of them in practice here in the revised version.
For the additional experiment regarding the interpretability claim. I appreciate them, but remain unconvinced that it adequately supports the interpretability claim.
The experiment primarily demonstrates consistency with the Grassfire evolution under oracle-assisted decoding.
In particular, the decoder relies on ground-truth intermediate visibility graphs, which are unavailable during inference. Therefore, it is unclear how much of the reconstruction quality can be attributed to the learned embeddings rather than to the provided graphs. Moreover, similar reconstruction performance does not necessarily imply that the latent states have an accessible or independently verifiable geometric meaning. I therefore believe that the experiment provides evidence of geometric consistency rather than interpretability.
Regarding the promised improvements to the presentation, it would have been helpful to see at least some of these changes already incorporated into the revised manuscript.
Additional Experiment - Interpretability
-
Intermediate-State Evaluation: We thank the reviewer for the clarification. We understand that the main concern with the additional interpretability experiment is that, since the decoder is provided with the ground-truth intermediate visibility graph , it is unclear how much of the reconstruction quality is attributable to the intermediate flow embedding versus the provided visibility graph. To clarify this, we perform an additional zero-latent experiment, where we replace with a zero vector while providing the decoder with the same .
Approach Chamfer Distance Visibility F1 0.24 0.09 0.83 0.05 0.27 0.09 0.82 0.05 Zero Latent 0.50 0.09 0.60 0.05 Using the same intermediate visibility graph, replacing with a zero vector increases the Chamfer distance from 0.27 to 0.50 and decreases visibility F1 from 0.82 to 0.60. This isolates the contribution of the latent embedding and shows that the reconstruction quality cannot be attributed to the intermediate visibility graph alone.
-
Presentation Changes: Regarding adding some presentation changes to the current version of the manuscript, we have added the supporting citations to the introduction in the revised manuscript. We will also use the additional page available in the final camera-ready version to include a concise description of the dataset construction and its key characteristics in the main paper.
Rebuttal by Authors
We thank the reviewer for their careful evaluation of our work. We appreciate their recognition of the promise of our experimental results. Below, we address the reviewer’s concerns regarding the interpretability claim, ablation study, and presentation.
Interpretability Claim: We acknowledge the reviewer’s concern that the interpretability of VisFlow was not explained clearly enough in the manuscript, and we apologize for the lack of clarity in our presentation. We refer to the method as interpretable because the learned latent trajectory is explicitly structured using Grassfire polygon evolution, so intermediate latent states are intended to correspond to meaningful intermediate polygon states rather than arbitrary points in the latent space, as in latent diffusion. However, these intermediate states cannot be directly decoded during normal inference using their corresponding visibility graphs because only the final target visibility graph is available at inference, while the intermediate visibility graphs are unknown. Therefore, to directly evaluate whether the intermediate flow embeddings are interpretable and follow the Grassfire evolution, we perform an additional comparison against the ground-truth Grassfire trajectory on held-out test polygons:
We first run Grassfire on the original unseen polygons from the held-out test set. For each polygon, we record the number of Grassfire steps N, the encoder embedding Zₜᴳᵀ of each intermediate state, and its ground-truth visibility graph Gₜᴳᵀ. We then perform N flow steps conditioned only on the target visibility graph G and store the corresponding intermediate flow embeddings Zₜ. We pass both Zₜᴳᵀ and Zₜ through our trained decoder using Gₜᴳᵀ and compare the decoded polygons with the corresponding ground-truth Grassfire polygon at time t using visibility F1 and Chamfer distance. Gₜᴳᵀ is used only for this experimental evaluation and is not available or used during normal inference for our reported results. We report the mean ± standard deviation across all intermediate states and held-out test polygons.
We observe that replacing Zₜᴳᵀ with Zₜ changes visibility F1 by only 0.01 (0.83 → 0.82) and Chamfer distance by 0.03 (0.24 → 0.27). Since both embeddings are decoded using the same intermediate visibility graph Gₜᴳᵀ and evaluated against the corresponding Grassfire intermediate polygon, this provides evidence that the intermediate flow embeddings correspond closely to the Grassfire evolution at the same stage.
Component Ablation: We thank the reviewer for raising the question regarding the contribution of the individual components of VisFlow. We have evaluated these contributions through dedicated ablation studies. Due to the space limitations of the main paper, we placed these results in the appendix rather than in the main text. Specifically:
Presentation: We appreciate the reviewer for highlighting the presentation concerns, and we apologize for the lack of clarity in the main content of the manuscript regarding the dataset contribution. Due to space limitations in the main paper, we placed the detailed dataset construction and characteristics in the appendix. We agree that some of this information would be helpful in the main text, and we will include a concise description of the dataset construction and its key characteristics in the final version. We will also add additional references to support statements in the introduction.