- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes PrismIQA, a no-reference IQA system for high-resolution images that splits assessment into four sequential stages: a Global Assessor, a Region Proposer, a Falsification Agent, and an Impact Assessor. The stages exchange a fixed structured state and are trained independently by GRPO or SFT followed by GRPO with no joint training. The paper argues, via a KL chain-rule decomposition and a diagonal-constraint argument, that four independently optimized models reach a lower class-optimal loss, and therefore a tighter reward-deviation bound. Empirically it reports SRCC/PLCC on seven datasets. There are also ablations to show the importance of each agent.
Critical strengths
The manuscript is generally well written, with clear and well-presented figures. The experiments follow the standard IQA evaluation protocol, including the main benchmark comparison and ablation studies.
Critical weaknesses
The paper devotes several pages to theoretical analysis, but the experimental comparison is not set up fairly.
- What is the training set? The paper does not state it. Sec. 5.1 only says that protocols “follow prior work”. Since the four-stage design closely mirrors how Vista-Bench is annotated, I suspect the models were trained on Vista-Bench or on data built with the same pipeline. The authors should state this explicitly, together with how overlap with the Vista-Bench test set was excluded.
- Is the comparison fair? For most baselines, they correspond to models trained on KADID-10K or KonIQ-10k and evaluated cross-dataset. The paper does not specify its training protocol, so it is impossible to judge whether the comparison is fair.
- What drives the improvement? PrismIQA uses four Qwen3-VL-8B models, but Table 1 includes only Qwen2.5-VL-7B as a base-model baseline, not Qwen3-VL-8B. The strongest MLLM-based baselines (Q-Insight, VisualQuality-R1, Q-Probe) are also built on Qwen2.5-VL-7B. It is therefore unclear whether the gains come from the stronger base model, from using four models instead of one, or simply from the training data.
Questions for authors
Is the theoretical analysis of training the four agents separately necessary? I am not an expert in this type of proof, but the main result appears to hold essentially by construction: four independent parameter vectors can always fit at least as well as one shared vector. This question would be answered more convincingly by an empirical comparison, just a single shared model trained on all four roles and run through the same pipeline. Appendix C.6 already trains such a model but reports only role losses. Reporting its SRCC/PLCC would directly test the claimed benefit of factorization. More generally, the benefit should be weighed against the practical cost of deploying four separate 8B models.
In my view, an image quality assessment paper can make a strong contribution through an insightful framework design and comprehensive experiments. The current theory adds length without strengthening the paper’s claims.
2 comments
Thanks for the response and additional results. However, my core concern remains unaddressed: the authors have not sufficiently justified why training four separate agents is necessary for this quality task.
So I will keep my rating as weak rejection now.
Rebuttal
1. Data Source and Training Setup
For every entry in Table 1, our data are drawn from VisualQuality-R1. Our model is trained on the training set of KADID-10K. This training setup is intended to demonstrate the model’s generalization ability, which is a common and accepted setting in IQA tasks.
2. Fair Comparison and Role-Specific Training
Our SFT trajectories are extracted from KADID-10K and partitioned into four role-specific subsets, so that each of the four agents learns its corresponding role. To address the reviewer’s concern about fairness, we additionally train a single Qwen3-VL-8B model on the same training data without role-specific extraction—i.e., a shared model trained jointly on all four roles. As shown below, this shared model underperforms both Q-Probe and our full model on Vista and average metrics, indicating that the gains are not merely due to the stronger base model or the training data alone; the role-specific factorization is important.