- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes MuralAgent, a training-free VLM agent (Qwen2.5-VL-72B) that detects stitching artifacts in large stitched mural images and decides whether each anomaly was introduced by stitching or is intrinsic mural degradation.
It combines (i) a spatial priority map (visual abnormality + CLIP similarity + hypothesis entropy − coverage) for choosing regions, (ii) VLM-scores, (iii) rule-based visual actions (e.g., ZOOM, VERIFY), (iv) a fixed hypothesis-to-forensic-tool routing table, (v) source-aware attribution that compares the stitched output with the source tiles, and (vi) a reflective experience memory. Experiments on the self-constructed MuralSI-Bench report F1 0.813 versus 0.742 for the strongest re-implemented agent baseline (JarvisEvo), with 18.6% high-resolution coverage and 9.4 VLM calls on average.
Critical strengths
-
A real and under-explored application problem. Detecting post-stitching artifacts in heritage murals, and separating them from intrinsic degradation, is practically meaningful. To my knowledge, no existing dataset jointly annotates both, so the benchmark effort has potential value.
-
Efficiency is reported alongside accuracy. The paper reports high-resolution coverage, VLM calls, and a recall–budget curve, and tests three backbones. This is the great evaluation for an inspection agent, even though the efficiency claims themselves are not fully substantiated (see weaknesses below).
Critical weaknesses
- The claimed contribution (uncertainty-driven agentic reasoning) is neither isolated nor well specified.
- Region selection uses a parameter-free average of four terms: visual abnormality, CLIP similarity, hypothesis entropy, and coverage. Actions and tools are then selected by rules and a fixed lookup table (Table 14). The method behaves like a "heuristic proposal → VLM verification" pipeline. At a fixed 18.6% area, changing only the region-selection strategy moves Det. F1 from 0.521 to 0.742, whereas uncertainty-guided action selection adds 0.071 (Table 10).
- S_vis, the key proposal term, is never operationally defined. A(·) and Agg in the source contrast are described only conceptually.
- The action rules are qualitative (e.g., "ZOOM when finer detail is required"), and App. C.2 restates Sec. 3.2. No threshold or procedure links the defined entropy to actions. STOP is not in the defined action set, yet App. A.3 says "the agent issues STOP," although the policy is described as rule-based.
- The attribution rule "absent from source → stitching" is hard-coded in the prompt (App. C.1). Every routing entry invokes source evidence. Nothing indicates that the baselines received this criterion.
- More than half of the improvement from the sliding-window VLM to MuralAgent is already achieved by generic agent baselines with the same tools and sources (e.g., JarvisEvo: Det. F1 0.623→0.742→0.813; Attr. F1 0.437→0.571->0.687).
- The ablations are hard to interpret. Removing memory alone (0.524) or source attribution alone (0.492) drops Attr. F1 below every agent baseline, even though GEMS and JarvisEvo also use memory and all agent baselines have source tools. No standard deviations are reported, despite 5 runs.
- The experimental validation cannot support the claims.
(a) Benchmark validity. Source tiles appear to be constructed from single MuralDH images ("we construct overlapping source tiles"), so real capture variation (parallax, illumination, lens) is likely absent, which could make source-based attribution nearly trivial. The six artifact types match the hand-designed routing table exactly. There is no separate result on real artifacts and no external validation (e.g., artifacts produced by real stitching algorithms on UDIS-D). Image resolutions, split sizes, severity definitions, the annotation procedure, and instruction generation are not described.
(b) Baselines. All agent baselines are re-implemented frameworks built for image editing, 3D generation, or data analysis. Missing are high-resolution visual search methods (e.g., V*, ZoomEye, DeepEyes, and Insight-o3, which the paper cites), a dense warped-source difference baseline, and a supervised detector trained with the released benchmark generator.
(c) Motivation and efficiency. No image resolutions, wall-clock times, or token costs are reported, and forensic-tool call counts, which App. A.1 says are reported, are absent. The claim that exhaustive inspection is too expensive is therefore unsupported. Under the same VLM, recall keeps rising with coverage to roughly 95% or more near full coverage, including MuralAgent's own curve, versus 87.4% at the default operating point. This trade-off needs justification for an offline preservation task.
Questions for authors
Clarifications that could change my assessment:
- Are source tiles crops of a single mural image, or independently captured photographs?
- How are S_vis and A(·) defined and computed? Does S_vis require dense high-resolution processing, and is that processing counted in the Area metric?
- What are the exact trigger conditions for each visual action? Does the VLM take part in action or STOP decisions?
- How are VLM calls counted? Please provide a per-role breakdown (ins, reason, verify, attr), state whether multiple regions are processed per call, and report forensic-tool call counts and wall-clock time.
- Did the agent baselines receive the same attribution criterion ("absent from source → stitching") in their prompts? Do the VLM baselines have access to tools or source tiles?
- Please report standard deviations over the 5 runs, as well as image resolutions and dev/test split sizes.
Additional experiments needed to support the claims (not future work): 7. Results on the real-artifact subset alone. 8. Comparison against (a) exhaustive inspection with the same tools and sources, (b) a dense warped-source difference baseline, and (c) high-resolution visual search methods (e.g., V*, ZoomEye, DeepEyes).
4 comments
Thank you for the response, however I would like to clarify two points.
- My review did not question whether the agent baselines share the tools and source one. My question was whether their prompts include the same attribution criterion ("absent from source → stitching"), which is hard-coded in MuralAgent's prompt (App. C.1).
- The sliding-window VLM is a VLM baseline, and the paper states tool sharing only for the agent methods. It therefore does not address Q8(a), exhaustive inspection with the same tools and source tiles.
The response does not address most of my questions: how the source tiles were obtained (Q1), the definitions of S_vis and A(·) (Q2), the action and STOP rules (Q3), the cost breakdown (Q4), the attribution criterion in the baseline prompts (Q5), the standard deviations (Q6), the results on naturally occurring artifacts (Q7), and the comparisons in Q8(b) and Q8(c).
No new results or revision were provided. My assessment therefore remains unchanged.
Response to Reviewer RuyV
We appreciate the follow-up. However, we respectfully disagree with the implication that the absence of every requested implementation detail or additional baseline invalidates the central contribution and existing experimental evidence.
1. The Main Scientific Contribution Should Not Be Overlooked
The review continues to focus predominantly on implementation details and additional experiments, without adequately engaging with the controlled evidence supporting our central claim. Our contribution is not a new anomaly detector or an individual tool-selection heuristic. It is a closed-loop inspection framework that coordinates spatial beliefs, competing hypotheses, adaptive observations, and source-grounded verification. Crucially, the contribution is experimentally isolated. At identical 18.6% coverage, MuralAgent improves Det. F1 from 0.742 to 0.813 over Spatial Belief (Table 10). Removing competing hypotheses reduces Attr. F1 from 0.687 to 0.583, while fixed evidence routing reduces it to 0.641 (Table 3). These controlled comparisons directly demonstrate benefits beyond region prioritization. A methodological assessment should consider these results rather than treating the absence of every possible baseline as evidence that the proposed mechanism is ineffective.
2. Baseline Fairness and the Requested Comparisons
We clarify that identical tool access and identical attribution instructions are distinct requirements. Our existing controlled protocol establishes the former: agent baselines share the same backbone, observations, forensic tools, and inference budgets. We do not rely on this fact alone to establish prompt-level equivalence. Regarding Q8, the criticism that our agent baselines require task-specific reimplementation applies equally to the proposed alternatives. A dense warped-source difference baseline, and high-resolution visual search methods were not originally designed for stitching-artifact provenance attribution. Evaluating them on this task likewise requires adapting their inspection interfaces, evidence access, and output protocols. Our baseline design follows a consistent principle: preserve each framework's defining reasoning and control mechanisms while providing a common inspection environment. This is a reasonable and meaningful evaluation strategy for a newly formulated task. We also distinguish the existing exhaustive Sliding-window VLM baseline from the requested exhaustive inspection with forensic tools. The former measures exhaustive visual inspection; it is not presented as a tool-matched exhaustive agent. The absence of the latter comparison limits one particular efficiency conclusion, but does not invalidate the existing tool-matched agent comparisons or the fixed-coverage exploration results.
Response to Reviewer RuyV
3. Source Images and the Nature of Mural Stitching (Q1)
The concern about source tiles overlooks an important characteristic of large-scale mural digitization. Murals may extend across multiple walls of an entire cave, making it physically impractical to capture the complete scene in a single photograph. Instead, multiple partially overlapping photographs must be acquired and stitched into a large-scale reconstruction. This process naturally introduces potential registration errors, ghosting, visible seams, and appearance inconsistencies. The source observations are therefore fundamental inputs to the reconstruction process, not privileged information introduced to simplify attribution. Our benchmark follows this acquisition-and-reconstruction setting by constructing overlapping source observations from real MuralDH murals and introducing controlled errors through the stitching pipeline rather than directly corrupting the final image. It also incorporates naturally occurring reconstruction artifacts and preserves intrinsic mural degradation.
4. Spatial Scoring, Actions, and Stopping (Q2–Q3)
MuralAgent combines deterministic control with VLM-based hypothesis reasoning; we do not claim to learn an action-selection policy.
Spatial priority combines four normalized quantities: visual abnormality, instruction relevance, hypothesis entropy, and inspection coverage. The visual abnormality term represents local geometric and appearance inconsistencies, while instruction relevance uses CLIP similarity. Hypothesis uncertainty is computed from the normalized entropy of competing explanations.
The VLM updates hypothesis plausibilities from newly acquired observations, while the controller determines the next action from the current inspection state. ZOOM acquires finer details, EXPAND adds surrounding context, PAN explores higher-priority neighboring regions, COMPARE examines corresponding observations, BACKTRACK revisits contradicted hypotheses, and VERIFY requests hypothesis-conditioned forensic evidence.
STOP is an episode-termination decision, not an additional visual observation operator. A region is resolved when its hypothesis is verified or rejected; the episode terminates when no unresolved high-priority region remains, a stopping decision is issued, or the inference budget is exhausted.
For source contrast, the anomaly evidence is hypothesis-dependent: geometric residuals support misalignment analysis, contour inconsistencies support ghosting analysis, and color or gradient discontinuities support seam analysis. Corresponding source observations are retrieved through geometric matching and used to distinguish reconstruction-induced abnormalities from intrinsic mural structures.
5. Attribution Fairness, Evaluation, and Cost (Q4–Q7)
Attribution fairness. We agree that equal access to forensic tools and equal attribution instructions are distinct considerations. Our controlled comparison guarantees identical VLM backbones, observation interfaces, source-evidence tools, and inference budgets for the agent baselines. MuralAgent additionally maintains explicit competing hypotheses and performs source-grounded verification.
The attribution criterion itself is not an arbitrary shortcut: determining whether an anomaly existed before reconstruction is the defining provenance question in stitching inspection. Moreover, attribution is not based solely on source absence; geometric and appearance evidence must also support the proposed explanation.
Evaluation protocol. MuralSI-Bench contains 512 source murals, 4,256 stitched images, 11,843 stitching-artifact instances, and 7,694 intrinsic degradation regions. Development and test data are separated at the source-mural level to prevent source-content leakage. The benchmark includes both naturally occurring reconstruction failures and controlled stitching-pipeline perturbations.
Inspection cost. The reported Area metric measures the union of regions accessed at high resolution, avoiding double-counting overlapping observations. VLM calls measure model inference invocations rather than individual visual crops or forensic-tool operations. The default inspection uses a four-level image pyramid and 512 × 512 local observations. These metrics specifically quantify visual inspection efficiency rather than total system runtime.
Conclusion
**The reviewer's follow-up emphasizes implementation completeness and additional comparisons, but these should not overshadow the central experimental evidence. These results directly support the contribution of closed-loop, hypothesis-driven evidence acquisition beyond heuristic region selection and generic agentic inspection. We respectfully encourage an assessment that gives appropriate weight to these controlled findings.
Response to Reviewer RuyV
Response to Reviewer RuyV
We thank the reviewer for the detailed comments. However, we respectfully disagree with several conclusions that overlook our controlled experiments and underestimate the contribution of MuralAgent.
1. Methodological Contribution
MuralAgent is not merely a "heuristic proposal → VLM verification" pipeline. Its contribution lies in integrating spatial belief, competing-hypothesis reasoning, and adaptive evidence acquisition into a closed-loop inspection framework. Importantly, Table 10 directly demonstrates the benefit beyond spatial prioritization. Under identical 18.6% inspection coverage, MuralAgent improves detection F1 from 0.742 to 0.813 and recall from 0.781 to 0.874 compared with Spatial Belief alone. Furthermore, Table 3 shows that replacing adaptive evidence routing with fixed routing reduces attribution F1 from 0.687 to 0.641, while removing competing-hypothesis reasoning reduces it to 0.583. These results demonstrate meaningful contributions beyond heuristic region selection.
2. Experimental Validity and Baseline Fairness
The reviewer overlooks that all multimodal agent baselines share the same VLM backbone, forensic tools, source observations, and inference budgets (Section 4.1 and Appendix A.2). Therefore, the improvements cannot simply be attributed to additional tools or evidence access. Compared with JarvisEvo, MuralAgent improves detection F1 from 0.742 to 0.813 and attribution F1 from 0.571 to 0.687, while reducing inspected area from 33.4% to 18.6%. Moreover, Appendix B demonstrates consistent improvements across six artifact categories, three severity levels, and three multimodal backbones. We acknowledge that external datasets would further strengthen generalization claims, but this does not invalidate the existing controlled comparisons.
3. Inspection Efficiency
The reviewer conflates maximum achievable recall with inspection efficiency. Our objective is to achieve strong detection performance under limited inspection budgets, rather than claim superiority over unlimited exhaustive inspection. Compared with exhaustive sliding-window inspection, MuralAgent improves detection F1 from 0.623 to 0.813, while reducing VLM calls from 48.6 to 9.4 (−80.7%). The matched-budget comparisons in Table 10 further confirm that MuralAgent outperforms random, uniform, and saliency-based exploration at identical spatial coverage. We agree that additional implementation specifications, external validation, and comprehensive runtime measurements would strengthen the paper, and will clarify the corresponding limitations.
Summary
The existing matched-budget experiments, component ablations, and controlled agent comparisons directly support the effectiveness of MuralAgent's uncertainty-driven inspection mechanism. We believe the reviewer's assessment underestimates this evidence and respectfully encourage reconsideration of the overall evaluation.