- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper reconstructs a time-varying 3D flow from the full low-resolution sequence when only high-resolution frames can be acquired. AIF-TVR selects those frames with an active-inference-inspired score over a time-factorized Gaussian belief, fine-tunes a conditional diffusion reconstructor on the acquired pairs, and reconstructs every frame. On three flow datasets at , it reports the better performance over the strongest baseline.
Critical strengths
-
The acquisition problem is distinct from standard super-resolution.
-
Selection and adaptation are separated, and the main limitations are stated.
Critical weaknesses
1. Belief updates never affect a later decision
Because the belief factorizes over time and depends only on the LR sequence, updating acquired frame leaves and unchanged for every unacquired frame (Section 3.3; Appendix A.4). The procedure is therefore a fixed per-frame ranking with candidate removal and a coverage term, rather than sequential belief-guided acquisition. This limitation is decisive for the headline setting : there is no later decision for the belief update to affect, so Table 1 does not test sequential updating.
2. The score is not connected to reconstruction gain, and its construction can favor uninformative frames
The score measures expected belief revision, not the downstream reduction in full-sequence reconstruction error, and no experiment relates the two. At , this missing link could be tested directly by comparing the score with each candidate's hindsight reconstruction gain. Moreover, the initializer and use the same input and target; when they agree, Proposition 2 reduces the information term to a predicted-variance ranking. With the preference set to the current belief and , the active-inference formulation is not shown to provide more than an uncertainty or expected-information-gain heuristic.
3. The experiments do not show that the acquisition rule produces the reported gains
Table 1 compares complete systems and therefore cannot isolate the acquisition rule; matched selection baselines under a fixed reconstructor and adaptation protocol are missing. The ablation does not resolve this because comes from a separate run. Its 5.17–5.94 dB gains are much larger than the to dB changes in the controlled variants, so they cannot be attributed to a specific component. The reported 43.68 dB one-frame result in Appendix C.2 is also not reconciled with the headline results. These comparisons use a single seed.
4. The theory does not address reconstruction quality, and the physical results are mixed
The propositions characterize the Gaussian update and estimation error, while Proposition 3 gives a generic descent condition requiring alignment with an unavailable full-sequence gradient. None connects the acquisition score to reconstruction quality. The physical diagnostics are also mixed: vorticity error improves, but normalized energy error increases by 430% on Re6400 and 22% on ShockVortex. Thus the evidence supports selected metric improvements, not a broad physical-fidelity claim.
Questions for authors
- If acquiring a frame leaves and unchanged for every remaining candidate, what makes selection sequential, and what does the belief update contribute to the results?
- At , what is the rank correlation between and each candidate’s hindsight reconstruction gain, and does the rule outperform random, uniform, maximum-variance, and LR-entropy selection with the same reconstructor and adaptation?
- When do the initializer and disagree, and, with and the preference set to the current belief, what does the score add beyond ranking by latent variance?
- Why does gain 5–6 dB when every controlled variant changes PSNR by at most 0.74 dB, and how is the 9.1 dB drop after one-frame adaptation in Appendix C.2 consistent with the result?
Critical Weaknesses:
1.At B = 1, hypothetical belief updates enter the score used to select the sole HR frame. The observed HR value updates only the selected marginal after that decision, and the acquired LR–HR pair supervises the reconstructor evaluated in Table 1. At larger budgets, the remaining candidates retain their base scores while temporal coverage and eligibility change. With those rules held fixed, precomputed analytic scores and round-by-round scoring yielded identical choices in all 117 decisions.
2.At B = 1, we scored every eligible candidate using LR and independently adapted the same reconstructor on each corresponding HR frame. Across three seeds, Spearman’s ρ between −G and PSNR gain ranged from 0.746 to 0.789 on ShockVortex, from −0.335 to −0.035 on Tangaroa, and from −0.366 to −0.126 on Re6400. When the predictor matches the observation distribution implied by the Gaussian belief, the exact information term reduces to Gaussian mutual information, proportional to the sum of log(1 + vⱼ/r) over latent dimensions. In the general case, differences in predictive means and variances can change both expected belief revision and predictive risk, so candidates with similar average latent variance can receive different scores.
3.Table 1 compares complete systems. To estimate the contribution of frame selection, we fixed the reconstructor and adaptation protocol and compared policies at B = 1 across three paired seeds. Relative to maximum-variance selection, the full policy changed mean PSNR by +0.688 dB on Tangaroa, +0.180 dB on Re6400, and 0.000 dB on ShockVortex. Results against other baselines varied by dataset. The 5.17 and 5.94 dB values in Figure 4 compare M3† from Table 1 with frozen baselines from a different protocol, so they cannot isolate the effect of frame selection or adaptation. Appendix C.2 measures a 9.11 dB within-run decrease under its own one-frame protocol, as detailed in our response to Q4.
4.Proposition 3 gives a sufficient descent condition that depends on alignment with the full-sequence gradient, which is unavailable during acquisition. The link to reconstruction gain is empirical. On ShockVortex, Spearman’s ρ between the acquisition score and hindsight PSNR gain ranged from 0.746 to 0.789 across three seeds. In Figure 6, AIF-TVR reduced median relative vorticity error compared with CD-TVD on all three datasets. Normalized kinetic-energy error decreased on Tangaroa and increased on Re6400 and ShockVortex. We will describe these two diagnostics separately in the revised manuscript.
Questions:
1.The policy builds the acquisition set one frame at a time. Each choice changes the eligible set and temporal coverage, while the remaining candidates retain their exact information and risk scores. At B = 1, hypothetical updates enter the initial acquisition score, and the acquired LR–HR pair is used to adapt the reconstructor. The real posterior update occurs after the sole selection.
2.At B = 1, we independently adapted the same pretrained reconstructor on each eligible HR frame. On ShockVortex, Spearman’s ρ between −G (higher acquisition priority) and hindsight PSNR gain was 0.746, 0.789, and 0.782 across three seeds. The correlation estimates were negative on the other two datasets. On ShockVortex, the full policy improved mean PSNR over random, uniform, and LR-entropy selection by 0.170, 0.163, and 0.061 dB, respectively, and tied maximum-variance selection at 40.366 dB. The policy’s relative performance varied across datasets.
3.The predictor qφ and the belief-implied observation distribution disagree when their means differ (m ≠ μ) or their variances differ (s ≠ v + r). Both discrepancies were largest on ShockVortex in the candidate sweep. Even with C(a) = 0 and the current belief as the preference, expected revision depends on s and (m − μ)², and predictive risk penalizes KL divergence from the current belief (Eqs. 20 and 22). These terms can distinguish candidates with the same latent variance. At B = 8 on Tangaroa, the full policy achieved 38.307 dB, compared with 38.167 dB for variance ranking and 37.773 dB for Gaussian mutual information.
4.The 5.17 and 5.94 dB values in Figure 4 subtract the frozen PSNR of the controlled ablations from M3† results obtained under the Table 1 protocol. These cross-run differences cannot measure an adaptation gain. We will report gains from matched before-and-after comparisons in Figure 4. In Appendix C.2, 1,000 steps of adaptation on Re6400 frame 4 reduced PSNR from 52.79 to 43.68 dB on the same set of 130 unobserved frames. Both Table 1 and Appendix C.2 use B = 1, but the C.2 decrease is measured within a separate run with its own checkpoint, HR frame, and evaluation set.