- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
WithinVAE combines a compact variational autoencoder with global DINO-style and local iBOT-style self-distillation from an EMA teacher. Initialized from One-D-Piece, it uses position-dependent token masking to support variable-length prefix decoding.
Critical strengths
- The paper investigates: whether an autoencoder’s own EMA teacher can improve semantic organization without explicit alignment to a separate pretrained recognition encoder.
Critical weaknesses
- The manuscript repeatedly refers to Appendices A/B and Algorithms 1–3, but the provided 13-page document ends with references.
- The contribution beyond One-D-Piece is insufficiently isolated.
- The claim of learning semantics without external supervision needs qualification.
- The generation experiments do not establish the benefit of self-distillation.
Questions for authors
- Can the semantic gains be demonstrated without this external perceptual signal, or can the claim be narrowed accordingly?
- How much prefix reliability is inherited from One-D-Piece? Can matched prefix-decoding comparisons against no masking, uniform masking, and Tail Token Drop isolate the proposed schedule?
- Does self-distillation improve downstream generation relative to the reconstruction-only and masking-only variants under identical generator settings?
- Can the referenced appendices and exact evaluation configurations be provided?