- Rating
- 4
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper introduces PRISM, a category-theoretic framework for representing, measuring, and refining multimodal analogies through explicit relational structure. PRISM extracts source and target domains into structured graphs of entities and relations, replaces entities with semantic roles, and defines a pullback score that measures cross-domain relational alignment using matched relation similarities together with a relational-chain bonus. The pullback score is validated on AnaloBench, where selecting the analogous story using the pullback score achieves 82.5% accuracy, compared with 88.5% for direct zero-shot prompting. The framework is then applied to visual metaphor generation through an iterative refinement loop. At each iteration, PRISM generates an image, extracts source and target relational graphs, computes structural feedback, and revises the generation prompt using the pullback score together with coverage, matched relations, extracted graphs, CLIPScore, the original metaphor, and the previous prompt. The paper evaluates the method on 200 metaphors using multiple image-generation baselines, GEPA-based prompt optimization, ablations, two VLM judges, and a human study with 80 participants. PRISM improves metaphor consistency and analogy appropriateness over zero-shot generation according to both VLM and human evaluation, with participants preferring the refined image in 57.65% of forced-choice comparisons. The paper also analyzes failure modes, including increasingly cluttered outputs and the use of rendered text as a shortcut for increasing the pullback score.
Critical strengths
-
The paper provides an explicit and interpretable representation of relational structure rather than treating analogy quality as a black-box scalar judgment. PRISM extracts source and target entities and relations, replaces entities with semantic roles, and enforces globally consistent cross-domain relation mappings. This is a meaningful attempt to connect classical structural accounts of analogy with current multimodal foundation models. The fact that removing semantic-role abstraction reduces AnaloBench accuracy from 82.5% to near chance provides useful evidence that the representation is doing nontrivial work.
-
The evaluation combines strong baseline coverage, human validation, and explicit analysis of PRISM’s failure modes. The authors use multiple image-generation baselines, two independent VLM judges, an 80-participant human study, GEPA comparisons, several ablations, and a second refinement model. They also explicitly report weaknesses of their own metric, including maximalism and the use of rendered text as a shortcut that can raise the pullback score without improving relational quality. This breadth and self-critical analysis strengthen confidence in the empirical findings and help contextualize the reported gains.
Critical weaknesses
The refinement procedure does not use the pullback score in isolation. At each iteration, the refinement model receives a rich feedback set that includes the pullback score, edge coverage, matched relation pairs, the extracted source and target graphs, and CLIPScore, together with the original metaphor and previous prompt. The extracted graphs and matched pairs already provide explicit information about which relations are preserved or missing. As a result, the current experiments do not isolate whether the pullback score itself contributes meaningfully to the observed gains, or whether the improvement is primarily driven by the richer structured feedback. The separate AnaloBench experiment shows that the pullback score contains useful analogical signal, achieving 82.5% accuracy, but this is an indirect validation of its role in visual metaphor refinement. It does not establish that the scalar score provides additional value once the refinement model already receives the extracted graphs, matched relations, coverage information, and CLIPScore. An ablation that removes only the scalar pullback score while keeping all other feedback unchanged would therefore be important for establishing the contribution of the paper's central scoring mechanism.
Questions for authors
Could the authors report an ablation in which the refinement model receives exactly the same feedback as full PRISM except for the scalar pullback score? Would performance remain comparable, or does removing the score materially reduce the gains? Given that AnaloBench validates the score only as a standalone analogy-selection signal, this ablation would help establish whether it provides additional value within the full refinement pipeline.
Dear Reviewer Ad9A, thank you for taking the time to read our paper and to provide feedback. We are happy to hear that you saw the value of using PRISM to meaningfully "connect classical structural accounts of analogy with current multimodal foundation models".
As we understand it, the main concern that you address is that we do "not use the pullback score in isolation". You then suggest that we should "report an ablation in which the refinement model receives exactly the same feedback as full PRISM except for the scalar pullback score".
We have run this ablation. Without the pullback score, most of PRISM's improvement disappears: the overall judge score drops from 7.87 to 6.44, with lower scores on every axis for both judges. In this ablation, the refinement model receives the same feedback as full PRISM (the input metaphor, CLIPScore, the extracted domain graphs and the matched relation pairs), and only the pullback score is removed.
Removing all structural feedback, so that the refinement model receives only the input metaphor and CLIPScore, reaches 6.99. The graphs and matched pairs therefore help only when the pullback score is present to indicate whether, and by how much, relational correspondence is improving. We added the ablations in the paper (Table 2).