- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes to couple a self-hosted student with a server-side teacher with the goal of gradually reducing reliance on the teacher by distillation. More precisely, for each request a VLM perception module writes a structured restoration brief, then the student restores the image. A VLM jusdge scores the result and depending on the score it's either passed to the teacher or not. The student is adapted on such data using LoRA.
Critical strengths
- The system is straight-forward and practical, with an overall well structured manuscript
Critical weaknesses
-
The paper is overall of low novelty. All components are existing of-the-self components used on what is a quite standard data mining/filtering technique. Even at a system level there is a vast corpus of works that study and tackle the problem either in the same or very similar way. Some examples: [1] Cache & Distil: Optimising API Calls to Large Language Models, 2023, [2] Cache me if you Can: an Online Cost-aware Teacher-Student framework to Reduce the Calls to Large Language Models, 2023, [3] Online Cascade Learning for Efficient Inference over Streams, 2024, etc. While the examples I've shared are primarily for LLM, there is no conceptual difference between the two at a method level. Similar systems were build for image system too (e.g. DiffServe, AMS, JITNet, or the already cited RealRestorer, which is very similar as a system).
-
Following on the above, the SRB-guided routing is also incrementally different from GGT-100K.
-
Agentic restoration with perception, judge and fallback are largely not covered (e,g: AgenticIR (ICLR 2025), HybridAgent (CVPR 2026), JarvisIR (CVPR 2025), EvoIR-Agent, etc). The paper should cite and compare with them, mentioning how they differ.
-
Multiple SOTA comparisons and baselines are missing. No test on the GGT-100K dataset, no comparison with RealRetorer etc. Moreover, no dedicated restoration models are compared (just image editors). For a more convincing comparison, the apper should cover the follow class of methods: Composite-degration restoration, All-in-one restoration (e.g. InstructIR, PromptIR, AdaIR, MoCE-IR, etc), Generative real-world restoration (e.g: LucidFlux, etc) and agentic restoration (e.g: AgenticIR)
-No human evaluation and no real ground truth used for eval (they are metrics against GPT-Image-2 outputs I believe).
-
The setup appears partially flawed: (1) the session boundary coincides with the update triger, hence curation accepts esentially everything. (2) there is a selection bias toward the teacher and (3) a self-preference bias due to how the judges are defined.
-
The continual-learning doesn't appear to offer notabel perforamnce gains. Moreover the GSP evidence is quite thin.
-
Very limited analysis
Questions for authors
Please see the section above as it covers the main points i would like to ask about. Some additional questions:
- Do the results hold under a non-OpenAI Judge, and in a human study?
- What is the Judge's agreement with humans at the 0.7 threshold?
- How does it compare with a GGT-100K-trained Qwen-Image-Edit, RealRestorer, and OneRestore/InstructIR on a real-GT benchmark (e.g. CDD-11) and on RealIR-Bench?
- How does Q2C compare against (a) offline fine-tuning on the same pairs and (b) random or uncertainty-based querying at the same Teacher budget?