- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
SCLTrack is a reasonably well-motivated architectural extension to an existing canonical-space garment tracking pipeline. Its three branches have distinct intended roles, and the memory update provides a mechanism for propagating correspondence information.
My main concern is that the manuscript establishes architectural plausibility more convincingly than it establishes the technical necessity and independent value of each design. There are also reproducibility questions concerning temporal training, inference, and the memory update.
Critical strengths
- Regional semantics, local geometry, and temporal identity address different failure modes in non-rigid correspondence.
- The method enriches the inter-frame feature before NOCS prediction rather than replacing the entire pipeline.
- Ordered canonical anchors provide a sensible indexing mechanism for retrieving historical evidence.
- The original representation remains available, which may reduce the risk of harmful auxiliary features.
- The method combines canonical-coordinate, mesh, surface, local-geometry, correspondence, and anchor-related objectives.
Critical weaknesses
- The manuscript states that training constructs a fresh previous-frame cache for each pair, whereas inference passes the updated cache sequentially. If the network is not adequately trained against accumulated prediction errors and stale or corrupted memory, the claimed temporal robustness may not hold over long sequences.
- The memory update queries the learned warp using fixed canonical anchors, then updates their task-space positions and features. If the warp becomes incorrect, the resulting memory can reinforce erroneous associations in subsequent frames. The current experiments do not sufficiently characterize this failure mode. In particular, there is no quantitative analysis of error accumulation over time or recovery after a tracking failure.
- The method uses nearby cached task-space positions to identify candidate anchors. This is a reasonable efficiency strategy, but it may exclude the correct anchor when a garment undergoes rapid motion or a region reappears far from its last observed position. The paper should clarify how candidate neighborhoods are constructed, how many anchors are retrieved, and whether the correct canonical identity remains available under large displacements.
- The full framework combines additional representations, gated fusion, recurrent memory, auxiliary anchor supervision, NOCS refinement, and volumetric reconstruction. The component ablations are useful, but do not fully disentangle architectural benefits from changes in supervision or training behavior.
- The paper defines numerous objectives and refers to their weighted sum, but the main text does not provide a complete, readily reproducible list of all loss weights and every important branch-specific configuration.
Questions for authors
- How does training expose the consistency branch to errors accumulated over many frames?
- What happens when a canonical anchor's predicted task-space position becomes substantially incorrect?
- How sensitive is performance to the number of anchors and the size of the memory retrieval neighborhood?
- Does the temporal branch improve identity recovery after a long occlusion, or mainly improve short-term feature aggregation?
- Can the full method be reproduced from the paper without relying on undocumented configuration files?