- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces EV-Cloth and its core module, A³E, for estimating the persistent state of deforming cloth between RGB frames. Events are associated with the predicted cloth surface and persistent material points; the resulting evidence is aggregated at material nodes, and a graph network predicts a residual correction to an action-conditioned dynamics prior. Corrected positions and displacement history are written back into the recurrent state, while subsequent RGB frames refine the geometry. On 24 held-out simulated trajectories, with approximately 30-Hz RGB observations and a 100-Hz state-update schedule, the method reduces material tracking error from 1.637 mm for the RGB-only observer to 1.047 mm, improving 22 of 24 trajectories. The real-world evaluation is limited in scale and uses image-plane checker correspondences rather than independently measured full 3D ground truth.
Critical strengths
- The paper studies the meaningful problem of estimating cloth state continuously between RGB frames, and integrates event association, material-node feature updates, recurrent state correction, and later RGB-based geometric refinement into a coherent loop.
- In the matched simulation setting, EV-Cloth reduces material tracking error by approximately 36% relative to the RGB-only baseline and improves 22 of 24 trajectories. The paper also includes controlled analyses that provide evidence for the roles of event information and recurrent updates in this setting.
Critical weaknesses
- Limited evidence for generalization and real-world performance. The simulation evaluation centers on 24 held-out trajectories, but the training and test sets share the same pool of cloth meshes. The experiments therefore do not establish generalization to unseen cloth geometries or physical scales, and the action-shift experiments do not directly evaluate held-out grasp locations. The real-world evaluation is also limited in scope and lacks independently measured full 3D material-state ground truth. These limitations make it difficult to determine whether the method generalizes beyond the specific simulated setting.
- Limited methodological novelty and insufficient comparison with alternative fusion strategies. Geometric association, feature concatenation, and graph-based residual prediction are individually established techniques. The main contribution appears to lie in their task-specific integration with recurrent state writeback, rather than in a substantially new association or fusion mechanism. Although the paper includes internal ablations, it lacks comparisons with alternative RGB-plus-event fusion or association methods under the same task and evaluation protocol. Thus, the experiments demonstrate the effectiveness of the proposed system relative to an RGB-only observer, but do not sufficiently establish the distinctiveness of the proposed design. In addition, Figure 2 appears to show addition between and , whereas Equation 11 specifies concatenation, creating an ambiguity in the method description. Moreover, Figure 2 raises concerns beyond visual presentation.
- The practical value for downstream manipulation remains unverified. The paper motivates persistent cloth-state estimation partly through its potential utility for downstream action planning, but it does not specify and evaluate a concrete downstream manipulation task. No task-level metrics, such as manipulation success rate or improvement in execution quality, are reported. Consequently, the practical benefit of the improved intermediate state estimates remains a plausible motivation rather than a demonstrated result.
Questions for authors
- In Figure 2, are and added or concatenated? Equation 11 specifies concatenation, while the figure appears to show addition. Please clarify the actual implementation and make the figure and equation consistent.
- Do the held-out simulation trajectories include cloth sizes or shapes, colors or patterns, grasp locations, and action conditions not seen during training? Please describe the train/test split and provide any available cross-condition generalization results. This affects the scope of the paper’s claims.
- Are there quantitative real-world results based on independently measured 3D ground truth? Are the checker references image-plane correspondences only? Are results available across multiple cloth configurations, grasp locations, or trajectories?
- What specific downstream task is intended by the discussion of downstream action planning, and has EV-Cloth been shown to improve its quantitative performance? If this has not been evaluated, should the downstream benefit be presented as a potential application rather than a demonstrated result?
- Can the authors compare against alternative fusion or association methods using the same RGB-plus-event input? How do the existing internal controls distinguish the contribution of event information from the contribution of the specific proposed architecture?
- Please clarify the intended interpretation of the centered residual . This difference centers the response at zero event descriptor for a fixed , but because is nonlinear, it does not generally make the correction independent of interactions between and . Is the paper claiming baseline centering only, or a stronger independence from ?