- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
PreActIR is an agentic image restoration framework that predicts tool consequences before execution. A tool-conditioned model estimates degradation reduction, quality and fidelity changes, benefit and harm probabilities, and uncertainty. The controller ranks candidate tools, executes a selected action, and uses a separately trained verifier to commit or roll back the result. The paper also introduces an offline candidate-frontier audit and examines targeted tool adaptation. Experiments include MiO100, a paired real-world dataset, and controlled out-of-fold ranking and execution-order studies.
Critical strengths
-
The problem is practically meaningful. Restoration tools can be expensive and may damage images when applied incorrectly. Predicting their effects before execution is a sensible way to reduce wasted calls.
-
The controlled comparisons provide useful evidence for pre-execution ranking. With the candidate pool, verifier, and budget fixed, predictive ranking substantially reduces tool calls and rejections compared with reactive trial and error.
Critical weaknesses
-
The deployment-time efficiency gains remain unverified. The headline call savings use reference-annotated degradation states rather than estimated states. Reported timing includes restoration-tool execution only, excluding prediction, verification, and other system overhead.
-
The benefit of the full world model over simple ranking is limited. Fidelity-head ranking achieves nearly identical call savings and slightly higher PSNR. Two-step lookahead does not improve results, and removing several utility terms leaves top-1 performance unchanged.
-
The main benchmark gains are difficult to attribute to the proposed predictor. The full system additionally uses post-execution candidate-value models, output ensembles, and an adapted HAT-S tool. Matched full-pipeline ablations are needed to separate their contributions.
-
Generalization evidence is limited. The mechanism studies use 160 states from only 20 clean-image identities, also used during development. On the real-world set, improved no-reference scores come with lower PSNR than all compared agents.
Overall, the paper establishes that pre-execution ranking can reduce restoration-tool trial and error. However, it does not yet convincingly establish the necessity of the structured world model or demonstrate the headline efficiency gains under realistic estimated states and complete runtime accounting. Additional full-system components also complicate attribution. These gaps currently outweigh the useful empirical analysis and diagnostic contributions.
Questions for authors
See weaknesses.
6 comments
Response to Reviewer SbTA (Part 2/3): (W3)
W3. Disentangling Full-Pipeline Attribution. To separate pre-action world-model (WM) ranking from post-execution selection, output blending (Groups A/B), and adapted HAT-S (Group C) in Table 1, we ran factorized full-pipeline ablations.
(1) Isolating WM's contribution. On 200 new rain–haze states (100 unseen source images, half with downsampling), we fixed the estimator, tool pool (without adapted HAT-S), post-execution selector, and blending, varying only the pre-execution selector at our primary two-stage budget :
\text{Pre-Execution Selector} & \text{Calls} & \text{Y-PSNR} \uparrow & \text{Y-SSIM} \uparrow & \text{LPIPS} \downarrow & \text{MUSIQ} \uparrow \\\\ \hline \text{Degradation routing} & 7.85 & 15.74 & 0.5989 & 0.455 & 29.274 \\\\ \text{WM (fidelity + } p^{\text{ben}}\text{)} & \textbf{7.79} & \textbf{16.24} & \textbf{0.6038} & \textbf{0.419} & \textbf{35.654} \\\\ \text{WM (full score)} & \textbf{7.79} & \textbf{16.24} & 0.6036 & \textbf{0.419} & 35.599 \\\\ \end{array}$$ With downstream modules fixed, **WM selection at ~7.8 calls improves Y-PSNR by +0.50 dB, LPIPS by -0.036, and MUSIQ by +6.38** (+0.035 MANIQA, +0.065 CLIP-IQA), showing that better root candidates directly raise the downstream ceiling. **(2) Downstream selection and blending.** Replacing the learned post-execution selector with a fixed training-derived tool-priority rule on the same 200 states ($B=8$) yields: $$\begin{array}{lcccc} \text{Selector (Fixed Downstream)} & \text{Y-PSNR} \uparrow & \text{Y-SSIM} \uparrow & \text{LPIPS} \downarrow & \text{MUSIQ} \uparrow \\\\ \hline \text{Degradation routing} & 15.39 & 0.5840 & 0.535 & 24.667 \\\\ \text{WM (fidelity + } p^{\text{ben}}\text{)} & 15.61 & 0.5943 & 0.522 & 25.837 \\\\ \text{WM (full score)} & \textbf{15.65} & \textbf{0.5956} & \textbf{0.519} & \textbf{25.984} \\\\ \end{array}$$ WM still beats routing on all metrics (+0.26 dB PSNR, +1.32 MUSIQ), while the learned downstream selector adds **+0.35 dB** for routing and **+0.60–0.63 dB** for WM. Separately, on 40 fixed-pool states, we isolated the 3-branch blend (Eq. 28) against the top-weight single learned branch: $$\begin{array}{lcccc} \text{Output Rule} & \text{Y-PSNR} \uparrow & \text{Y-SSIM} \uparrow & \text{LPIPS} \downarrow & \text{MUSIQ} \uparrow \\\\ \hline \text{Fixed priority (no selector/blend)} & 21.07 & 0.6510 & 0.369 & 58.184 \\\\ \text{Single-branch learned selection} & 22.84 & 0.6998 & 0.300 & \textbf{62.978} \\\\ \text{Three-branch blend (Group A/B)} & \textbf{23.04} & \textbf{0.7066} & \textbf{0.296} & 62.616 \\\\ \end{array}$$ Candidate selection drives most of the gain (+1.77 dB), while 3-branch blending adds a modest **+0.20 dB PSNR** (-0.36 MUSIQ). **(3) HAT-S adaptation on Group C.** Across all 400 Group C states under identical fusion: $$\begin{array}{lcccc} \text{Group C SR Configuration} & \text{Y-PSNR} \uparrow & \text{Y-SSIM} \uparrow & \text{LPIPS} \downarrow & \text{MUSIQ} \uparrow \\\\ \hline \text{Without SR branch} & 19.49 & 0.5469 & 0.437 & \textbf{58.426} \\\\ \text{Original HAT-S + fusion} & 19.69 & 0.5639 & 0.462 & 54.676 \\\\ \text{Adapted HAT-S + fusion} & \textbf{21.05} & \textbf{0.6040} & \textbf{0.418} & 54.782 \\\\ \end{array}$$ Replay-adapted HAT-S adds **+1.36 dB** overall (+2.71 dB on the 200 low-resolution states). All three ablations will be added to the revised paper. **(4) Budget sensitivity.** Paired differences (Full WM minus Routing) across $B \in \{4, 8, 12\}$ on the 200-state two-stage pipeline are: $$\begin{array}{lcccc} \text{Total Budget (WM vs. Routing Calls)} & \Delta \text{Y-PSNR} \uparrow & \Delta \text{Y-SSIM} \uparrow & \Delta \text{LPIPS} \downarrow & \Delta \text{MUSIQ} \uparrow \\\\ \hline B = 4 \text{ (3.30 vs. 3.56)} & -0.48 & -0.0316 & +0.035 & +2.120 \\\\ B = 8 \text{ (7.79 vs. 7.85)} & \textbf{+0.51} & \textbf{+0.0047} & \textbf{-0.036} & \textbf{+6.325} \\\\ B = 12 \text{ (11.08 vs. 10.90)} & +0.17 & -0.0118 & -0.019 & +3.402 \\\\ \end{array}$$ In two-stage expansion, $B=4$ leaves too few calls after stage-1 root exploration to finish stage-2 refinement, whereas at $B=12$ even routing eventually exhausts the pool. At a practical mid-sized budget ($B=8$), pre-action ranking focuses calls on promising branches (+0.22 dB PSNR and +9.24 MUSIQ on the $\times 4$ subset). **In short, these factorized ablations cleanly separate each module's role:** pre-action WM ranking drives a +0.51 dB PSNR and +6.33 MUSIQ gain under fixed downstream rules, learned post-execution selection adds +0.60 dB, and blending (+0.20 dB) plus Group C tool adaptation (+1.36 dB) provide orthogonal improvements that we will detail in the revised paper.Response to Reviewer SbTA (Part 3/3): (W4, Summary)
W4. Generalization Beyond the 20 Dev Identities & The Real-World PSNR Trade-Off.
(1) Generalization to 200 unseen source images. We completely understand your concern that the 160 OOF states in Secs. 4.3–4.4 came from 20 clean-image identities. That is why both new mechanism studies in W2 (100 new source images / 200 states) and W3 (another 100 disjoint source images / 200 states, verified pixel-disjoint from both MiO100 dev and W2) were conducted on 200 entirely new source identities drawn from external AiOIR archives. Across both sets, the benefits of multitask world-model supervision (W2) and pre-action tool selection under estimated states (W3) transfer cleanly to unseen images.
(2) Understanding the lower PSNR on the 100 real-world pairs (Table 2). Your question about why PreActIR has lower PSNR (22.64 dB) than other agents on the real-world paired dataset prompted us to inspect the raw input–reference pairs directly. What we found was eye-opening, when we compute the exact same metrics on the unprocessed degraded input images () against the ground-truth references, we get:
\text{Metric on Real‑World 100 Pairs} & \text{Degraded Input } (I_0) & \text{PreActIR Output} \\\\ \hline \text{LPIPS (Full‑Reference)} \downarrow & 0.445 & \textbf{0.370 (-16.7\\%)} \\\\ \text{MUSIQ (No‑Reference)} \uparrow & 35.421 & \textbf{57.330 (+21.91)} \\\\ \text{MANIQA (No‑Reference)} \uparrow & 0.239 & \textbf{0.389 (+0.150)} \\\\ \text{CLIP‑IQA (No‑Reference)} \uparrow & 0.338 & \textbf{0.525 (+0.187)} \\\\ \text{Y‑PSNR (Full‑Reference)} \uparrow & \textbf{24.94} & 22.64 \\\\ \text{Y‑SSIM (Full‑Reference)} \uparrow & \textbf{0.7521} & 0.7310 \\\\ \end{array}$$ Notice a striking phenomenon: the unprocessed degraded input $I_0$ has a Y-PSNR of 24.94 dB, which is higher than every single restoration method in Table 2 (including SEAR at 24.41 dB, MiOIR at 24.00 dB, and AgenticIR at 23.93 dB)! In real-world capture pairs, actively removing haze, low-light darkness, or blur inevitably shifts global luminance/tone and reconstructs sharp textures that deviate pixel-wise from the pseudo-reference; thus, a conservative model that barely modifies the image preserves higher pixel-wise PSNR. Crucially, however, our improvement is **not** limited to no-reference metrics: on **full-reference LPIPS**, PreActIR reduces error by **16.7% (from 0.445 to 0.370)** while substantially boosting visual quality (Fig. 5). We will add the degraded-input baseline row to Table 2 so readers can immediately see this distortion–perception dynamic on the real-world set. --- **Summary of Revisions** Thanks to your feedback, our revised manuscript will be significantly stronger and more transparent: 1. Realistic End-to-End Efficiency (**W1**): We will add the end-to-end wall-clock benchmark under estimated states showing **51% / 23% real latency savings** (11.15s vs. 22.55s / 14.54s) with all prediction and verification overhead included. 2. Streamlined World-Model Narrative (**W2**): We will include the paired training study proving that **structured multitask supervision** improves all 6 restoration metrics over fidelity-only training, while simplifying our default inference score to the compact formulation. 3. Full-Pipeline Ablations & Generalization (**W3 & W4**): We will add the factorized ablations on **200 unseen source identities** isolating pre-action WM selection (+0.51 dB PSNR, +6.33 MUSIQ at $B=8$), post-execution selection, blending, and HAT-S adaptation, alongside the input-baseline analysis for Table 2. We hope these new experiments and clarifications directly address your concerns, and we would be happy to discuss any further questions!
Response to Reviewer SbTA (Part 1/3): (W1, W2)
We sincerely thank you for reading our paper and appendices so closely. Your critiques on realistic estimated states, the value of the multi-head world model over a simple fidelity scorer, and full-pipeline attribution are completely fair and pinpoint where our evaluation needed stronger controls. Motivated by your feedback, we ran strictly controlled experiments and share our findings below.
W1. End-to-End Efficiency Under Estimated Degradation States. You rightly noted that Table 4 relied on reference-annotated states and counted only tool execution time. To test realistic deployment efficiency, we ran an end-to-end wall-clock evaluation using estimated degradation states and complete runtime accounting on an RTX 4090.
We evaluated 96 states (12 clean identities) using out-of-fold models, a shared candidate pool, the learned verifier, and budget B=4. Timing spans input reading to output writing, including degradation estimation, world-model prediction, tool loading/execution, verification, and rollback (with controller weights preloaded):
\text{Method} & \text{End-to-End Time (s/image)} & \text{Calls/image} & \text{Y-PSNR (dB)} \\\\ \hline \text{Reactive trial-and-error} & 22.55 & 3.55 & 20.27 \\\\ \text{Degradation-based routing} & 14.54 & 2.36 & 21.80 \\\\ \text{PreActIR (ours)} & \textbf{11.15} & \textbf{1.78} & \textbf{21.93} \\\\ \end{array}$$ Even with full system overhead and state-estimation noise, **PreActIR cuts wall-clock latency by 50.6% vs. trial-and-error and 23.3% vs. routing**, using fewer calls (1.78 vs. 3.55 / 2.36) while reaching higher PSNR (21.93 dB). Because the world model and verifier are lightweight forward passes, their overhead is negligible compared to the heavy restoration tools they avoid calling. **W2. Why Train a Structured World Model If Simple Ranking Works Well?** This is a sharp observation: in Table 4 and Appendix Table 7, ranking by the fidelity head alone is close to the full 7-term score, and two-step lookahead ($H=2$) does not beat single-step ranking. **(1) Multitask supervision significantly improves the predictor itself.** To isolate the training benefit, we ran 3 paired seeds with identical architecture, initialization, data, batch order, and 3,000 updates, varying only whether the model was trained on fidelity alone or on our joint multitask targets. We evaluated both on 200 unseen rain/haze states (100 new source images) under estimated states, 6 shared tools, a frozen verifier, and budget $B=4$: $$\begin{array}{lccccc} \text{Setting} & \text{Calls/image} & \text{Y-PSNR} \uparrow & \text{Y-SSIM} \uparrow & \text{LPIPS} \downarrow & \text{MUSIQ} \uparrow \\\\ \hline \text{Fidelity-only training (scored by fidelity)} & 2.67 & 17.39 & 0.616 & 0.370 & 36.272 \\\\ \text{Multitask training (scored by fidelity only)} & 2.65 & 17.52 & 0.624 & \textbf{0.360} & 37.230 \\\\ \text{Multitask training (scored by fidelity + } p^{\text{ben}}\text{)} & \textbf{2.50} & \textbf{17.60} & \textbf{0.627} & \textbf{0.360} & 37.000 \\\\ \text{Multitask training (full 7-term score)} & 2.53 & 17.57 & 0.626 & \textbf{0.360} & 37.110 \\\\ \end{array}$$ Comparing the first two rows, which use the exact same inference ranking formula ($\Delta\widehat{\text{PSNR}}_Y + 10\Delta\widehat{\text{SSIM}}_Y$), shows that jointly supervising the model on structured action consequences improves every quality metric. Learning *how* a tool alters specific degradations and whether it causes harm regularizes the shared representation and yields more accurate fidelity predictions on new images. **(2) Simplifying the inference score.** Once the multitask model is trained (last three rows), a compact score combining fidelity gain and benefit probability ($p^{\text{ben}}$) reduces calls from 2.65 to 2.50 and selects the exact same output as the full 7-term score in 95.2% of cases (571/600). This also explains Appendix Table 7: under global actions, outside-region damage $d$ is zero by definition and $C(a)$ serves only as a tie-breaking prior, while the side-effect term ($\xi$) drives nearly all remaining differences (20/160 dev states and 31/600 new pairs) with a minor PSNR/MUSIQ trade-off. We completely agree with your critique of over-complicating the inference formula. **In the revised paper, we will foreground multitask consequence learning paired with compact one-step scoring (fidelity + $p^{\text{ben}}$)**, while presenting the extra utility terms and $H=2$ rollout transparently as ablation explorations rather than core complexity.