- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper introduces Narrative Cultural Re-instantiation, a task that aims to generate a video that reinterprets a source narrative within a specified target culture while preserving its narrative structure. To address this task, the authors propose CultureWeaver, a training-free framework that leverages a Visual Cultural Memory (VCM) constructed from documented cultural sources. The authors instantiate this memory for two historical cultural contexts: Chinese and Persianate. Each VCM is represented as a graph of cultural records (characters, objects, and scenes), their supported relations, and associated visual evidence.
The paper also introduces four task-specific evaluation metrics covering narrative preservation, cultural content fidelity, functional validity, and relational coherence. CultureWeaver is compared against several baselines using six evaluation metrics, with both automatic and human evaluations demonstrating consistent improvements in narrative and cultural fidelity. Ablation studies investigate the contributions of the cultural memory representation and structural correspondence mechanism.
Critical strengths
The paper presents comprehensive experiments, including both automatic and human evaluations across two target cultures, as well as ablations of the proposed method's components. CultureWeaver consistently outperforms the baselines on the main narrative and cultural evaluation metrics, while the ablations demonstrate the contributions of most individual components. Overall, the experimental results support the effectiveness of the proposed methodology, subject to the clarifications requested in the "Questions for Authors" section.
Critical weaknesses
Limited robustness to cultural-memory coverage and unclear interplay with parametric knowledge.
CultureWeaver relies on a cultural memory whose records and relations may not fully capture broader cultural compatibility. Graph connectivity may reflect co-occurrence in source illustrations rather than meaningful cultural relationships, and potentially favor suboptimal substitutions. Moreover, the method requires assigning every narrative node to a memory candidate, even when no suitable match exists. The experiments do not assess CultureWeaver's performance in such scenarios, and it remains unclear whether the method would still outperform baselines relying primarily on parametric cultural knowledge.
On a relevant note, while the parametric-only ablation in Table 4 demonstrates the benefits of external grounding, it does not disentangle conceptual cultural knowledge (e.g., social roles and relationships) from visual knowledge (e.g., clothing and architecture). It remains unclear when the method should rely on the external graph versus the models' potentially broader parametric knowledge, particularly when the two provide conflicting or incomplete evidence. The paper would benefit from evaluating robustness under limited memory coverage and examining how these two knowledge sources complement each other.
Questions for authors
-
Ablation with retrieved images only: Could the authors clarify whether the flat visual memory baseline in Table 4 uses the same retrieved images as the full CultureWeaver method, but without access to the graph's structured cultural information? If not, an ablation that provides the same retrieved images to the generation pipeline, without the graph's semantic and relational information, would help disentangle the contributions of visual grounding and structured cultural knowledge.
-
Instance-level agreement between human and automated evaluations: Table 3 reports agreement between human and VLM-based evaluations using method-level rankings aggregated across instances. Could the authors also report instance-level ranking agreement (e.g., Spearman or Kendall correlation per scene and target culture)? High method-level agreement does not necessarily imply that the automated metrics reliably distinguish the quality of individual generations. Since both human rankings and automated scores are already available, this analysis would provide stronger validation of the proposed evaluation metrics.
-
Prompts for cultural-memory construction: The supplementary code includes prompts used in the generation and evaluation pipelines, but I could not find those used to construct the Visual Cultural Memory. Could the authors provide the prompts used to extract and annotate cultural records and relationships, or clarify where these can be found? These are important for reproducibility, given the central role of memory construction in the proposed methodology.
-
Ethical considerations: Could the authors expand on the ethical risks associated with the proposed task and methodology, beyond acknowledging the work's research-oriented nature? Discussing concrete risks and possible mitigation strategies would strengthen the ethical considerations section, which is limited at the moment.
Typo: Line 135: openration -> operation
5 comments
Comment 2/3 — Q1–Q2: Fixed-reference ablation and full-benchmark human agreement
Q1. Does Flat Visual Memory use the same final images as Full?
No. Table 4(A) uses the same underlying visual archive for Flat Visual Memory and Full, but each method independently selects its final references (App. L.4).
To isolate structured conditioning from visual evidence, App. M.2 (Tables 19–20) evaluates a matched-input control on 50 stories × two cultures (100 conditions). All three variants receive the same six Full-selected images in identical order. Each independently generates its canonical frame with GPT-4o, followed by the same PixVerse V6 video backend under matched settings (Auxiliary Table M2).
| Method (GPT-4o → PixVerse V6) | CRV ↑ | CRC ↑ |
|---|---|---|
| PixVerse V6 + Retrieved Images (Images-only) | 84.10 | 79.70 |
| PixVerse V6 + Independent Matching | 85.30 | 82.80 |
| CultureWeaver (PixVerse V6) | 86.10 | 88.20 |
Images-only uses images and source narrative/actions without explicit cultural bindings. Independent adds node-wise cultural bindings without joint transport or target-relation instructions. Full adds RA-srFGW joint bindings and directed relational conditioning.
Table 20 reports Full–Independent +5.40 CRC [0.79, 10.24] and Full–Images-only +8.50 CRC [4.63, 12.42] (95% paired CIs). Both intervals exclude zero, whereas the corresponding CRV gains (+0.80/+2.00) are not statistically resolved.
Conclusion: identical references and generation backbones do not fully explain the relational gains; explicit cultural bindings and directed relational conditioning provide additional value. Table 4(B) separately evaluates matching strategies within the shared VCM pipeline (CRC 77.3 Independent vs. 88.5 Full).
Q2. Does human–automatic ranking agreement hold per scene, not just over seven aggregate method means?
Yes. We now evaluate all 400 scene–culture conditions, rather than a sampled subset. The blind full-video study includes 303 participants and 2,424 participant-condition evaluations (Table 2; App. H). Each condition receives six or seven independent rankings of all seven methods.
App. N.1 (Tables 24–25) reports within-scene human–automatic Spearman correlations:
| Target culture | NP | CCF | CRV | CRC |
|---|---|---|---|---|
| Chinese | .677 | .704 | .759 | .826 |
| Persianate | .735 | .714 | .806 | .695 |
| Macro-average | .706 | .709 | .783 | .761 |
All four mean correlations have positive story-bootstrap 95% CIs (Table 25). Human inter-rater Kendall's W is .677/.726/.707/.664 for NP/CCF/CRV/CRC, respectively, supporting agreement among independent raters.
These full-benchmark results complement the method-level Spearman correlations in Table 3 (NP .839, CCF .946, CRV .821, CRC .888).
Separately, App. N.2 (Table 26) reports pre-aggregation Gemini–Claude exact agreement of 76.3%/73.7%/71.6%/73.0% for NP/CCF/CRV/CRC, with weighted κ=.605–.635.
Conclusion: human–automatic ranking agreement persists within individual generation conditions across the complete benchmark, rather than only among aggregate method means. Human inter-rater concordance and independent VLM agreement provide complementary reliability evidence.
Comment 3/3 — Q3–Q4: VCM construction reproducibility, ethics, and typo
Q3. Where are the prompts used to construct VCM?
App. L.2 provides the full construction-stage annotation instruction, input template, structured output specification, and human-review protocol, complementing Secs. 4.1–4.2 and Apps. I/J. Each request supplies target culture, source-unit ID, source image(s), original caption, metadata/provenance, and local context. The instruction extracts typed character/object/scene records, narrative functions, affordances, visual/contextual attributes, and directed subject–predicate–object relations with supporting image IDs and evidence explanations. Action, causal, and temporal information is retained as auxiliary event context, not additional transport nodes.
How is evidence quality controlled? The construction instruction distinguishes OBSERVED (direct source support) from INFERRED (uncertain model interpretation); VERIFIED is assigned only after human review. All retained model-derived annotations are reviewed against source evidence. Unsupported historical claims, invented cross-source relations, and story-specific hand-written replacements are excluded (App. L.2; Sec. 4.2). App. L.3 (Table 18) documents reproducible curation effort:
| Memory | Units screened | Units retained | Person-hours |
|---|---|---|---|
| Chinese | 361 | 276 | 92 |
| Persianate | 198 | 130 | 66 |
| Total | 559 | 406 | 158 |
Conclusion: VCM is a documented, human-reviewed, reusable cultural evidence resource, not an unreported prompt-generated graph or a set of manually specified Western-to-target replacements.
Q4. What are the concrete ethical risks and safeguards?
The expanded Ethics Statement and App. O.3 specify archival and elite-class bias, stereotypes, cultural/period overgeneralization, sensitive religious or historical representations, and source-image rights. Safeguards include retaining source provenance and OBSERVED/INFERRED/VERIFIED status, human review of retained cultural annotations, period-aware generation instructions, and respect for image licenses and attribution. We recommend explicitly labeling generated outputs as fictional adaptations and culturally knowledgeable review for sensitive or public-facing uses. Sec. 7 further defines the task boundary: this is evidence-grounded fictional narrative re-instantiation, not authoritative historical reconstruction. Conclusion: the proposed grounding makes cultural choices traceable and their representational scope explicit, while preserving the distinction between adaptation and historical authenticity.
Typo. The spelling at the cited location has been corrected to “operation” in Sec. 3. Thank you for these suggestions.
Comment 1/3 — Critical Weaknesses: Cultural Relations, Memory Coverage, and Parametric Knowledge
Thank you for your thoughtful review and constructive suggestions. We have added controlled experiments and further clarified the roles of cultural evidence and structural correspondence.
1. Are VCM relations merely image co-occurrence?
No. VCM encodes functions, affordances, provenance, and semantically labeled directed relations (Secs. 4.2–4.3; Apps. J.4, L.2). Same-image assignment is not enforced: missing relations incur a finite cost of 0.90, and Full bindings span 3.04 source units on average (Apps. I.1, M.5).
Removing relation semantics reduces CRC from 88.5 to 78.4 (Table 4(B)). Removing context-derived edges while fixing candidates and evidence-linked relations decreases CRC by 2.93 [1.27, 4.55] (Table 23, 95% CI). App. D (Tables 7–8) further shows a relation-supported assignment reducing joint cost by 5.9%.
These results support the contribution of directed relational evidence beyond simple image co-occurrence.
2. How does CultureWeaver handle incomplete memory?
CultureWeaver preserves narrative roles, functions, and directed interactions, selecting the best-supported functional correspondences from available VCM candidates without requiring literal cultural equivalents (Sec. 4.3; App. O.2).
Our new coverage experiments (App. O.1, Table 28) evaluate 50 stories across two cultures. Removing essential counterpart families decreases CRV/CRC by 2.85/5.34; retaining 50% of nodes decreases them by 2.90/4.44; retaining 50% of edges decreases CRC by 4.06.
These results show that functional coverage supports suitable substitutions, while relational coverage supports coherent interactions.
3. Does external grounding improve over parametric-only generation?
Yes, under complete-memory conditions. Table 4(A) reports CRC 88.5 for Full versus 79.2 for Parametric-only. Table 28 further measures performance changes as cultural evidence becomes sparser.
Together, these experiments demonstrate the benefit of external grounding and characterize its dependence on memory coverage, without assuming superiority at every sparsity level.
4. What do conceptual cultural knowledge and visual evidence contribute separately?
Cultural functions, affordances, and relations guide which records satisfy narrative requirements; linked images guide their visual realization (Sec. 4.3; App. L.4).
Table 4(A) compares Full with Flat Visual Memory using the same underlying archive (CRC 88.5 vs. 80.4). More directly, App. M.2 (Tables 19–20) fixes the same six images across 100 conditions, using identical GPT-4o first-frame and PixVerse V6 video backbones.
Images-only uses references without explicit cultural bindings; Independent adds node-wise bindings; Full adds RA-srFGW joint binding and directed relational conditioning.
Full improves CRC over Images-only by +8.50 [4.63, 12.42] and over Independent by +5.40 [0.79, 10.24] (95% paired CIs). Both intervals exclude zero, while the CRV differences are not statistically resolved.
Thus, structured cultural conditioning improves relational coherence even with identical images, complementing structure-guided reference selection.
5. When VCM evidence and parametric knowledge disagree, which governs assignment?
RA-srFGW determines explicit bindings using VCM-grounded functional and relational costs. Frozen models interpret narratives, plan actions, and render selected evidence without automatically replacing assignments with unsupported parametric alternatives (Secs. 5.3–5.4; App. O.2).
Under matched evidence and rendering, Table 5 reports CRC 88.5 for RA-srFGW versus 85.8 for GPT-4o Joint Assignment. App. M.3 (Table 21) confirms +2.70 CRC [1.03, 4.44] across 200 paired stories.
This supports the additional value of explicit evidence-grounded structural correspondence over direct LLM joint assignment.
We appreciate the reviewer's suggestions, which have helped us strengthen both the controlled evaluation and the discussion of cultural-memory coverage.