- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes InfoProgress, a classifier-free guidance scheduling method for masked generative models. It estimates conditional evidence from accepted tokens during a calibration run and uses the accumulated evidence to construct a guidance schedule. Experiments on MaskGIT and MaskBit show improvements over constant guidance, with performance generally close to that of tuned fixed schedules.
Critical strengths
- The method does not require model retraining and achieves noticeable improvements over tuned constant CFG. The authors also evaluate it across different decoding budgets, token grids, model sizes, and codebook settings.
Critical weaknesses
-
The proposed approach primarily replaces normalized decoding time with an estimated information-progress measure, followed by a fixed power mapping. The theoretical results are largely straightforward identities and do not establish why this construction should produce better guidance schedules than existing approaches.
-
InfoProgress does not outperform the best tested fixed schedule in any of the eight settings in Table 2, and the held-out results are nearly identical to those of a simple quadratic schedule. The experiments do not convincingly establish the additional value of measuring conditional information, especially given the required calibration.
Questions for authors
-
In Table 2, InfoProgress does not outperform the best fixed schedule in any setting. What is the actual advantage of using the information clock instead of a simple quadratic or linear schedule?
-
Could the improvements mainly come from applying stronger guidance in later decoding steps? How do we know that the conditional-information measure itself is important?
-
Since InfoProgress still requires calibration and guidance-strength tuning, does it actually reduce the overall tuning cost compared with using a fixed quadratic schedule?