- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies LLM-driven simulations of social information diffusion, focusing on the accessibility of source evidence after messages are reposted or rewritten and on how such evidence affects propagation decisions. The authors propose MARS, which maintains links between claims in the diffusion process and their original sources, allowing receiving agents to consult relevant evidence before acting. They also introduce MM-InfoBench, a benchmark linking original posts from real-world events to their subsequent diffusion traces. The experiments examine how source evidence and images affect simulated decisions and diffusion and assess whether simulation-derived behavioral features can help predict the growth of real-world cascades. The paper’s contributions lie in incorporating source verification into multimodal information-diffusion simulation and providing a corresponding benchmark and empirical analysis.
Critical strengths
- The proposed framework provides a well-motivated approach to incorporating source verification into LLM-based social simulation. By maintaining explicit links between propagated claims and their source evidence, MARS enables agents to access relevant information even after messages are forwarded or rewritten. This design integrates source verification into agents' propagation decisions and provides a useful framework for studying how evidence access influences individual decisions and collective diffusion behavior.
- The paper introduces MM-InfoBench, a dataset comprising 11,066 real-world events, including 5,654 events with source images and approximately 3.88 million timestamped cascade nodes. The dataset explicitly links multimodal source evidence, propagated claims, and observed diffusion trajectories, providing valuable data support for studying the role of multimodal evidence in information diffusion.
Critical weaknesses
- The paper aims to improve the realism of information diffusion simulations, but the experiments mainly show how evidence access affects LLM agents' decisions and simulated diffusion outcomes, without directly validating their consistency with real-world user behavior. Although Section 4.5 evaluates the predictive value of simulation-derived features, this does not necessarily demonstrate behavioral realism.
- The proposed method mainly extends existing LLM-based social simulation frameworks by preserving claim–source associations and enabling evidence querying before propagation decisions. The multimodal component follows the same mechanism by incorporating source images, while agent decisions still rely on existing LLMs. Overall, the method primarily integrates evidence access into existing simulation frameworks, with limited methodological novelty.
Questions for authors
- Section 4.5 evaluates whether simulation-derived features can help predict cascade size. Please provide direct comparisons of agent behavior and diffusion patterns with those observed on real social networks to show that source verification improves simulation realism and distinguish the predictive value of these features from the realism of the simulation itself.
- If a claim is maliciously rewritten as it spreads, changing its meaning into a false or inflammatory statement, how does MARS detect this change and update the claim–source association? If the system retains the original claim ID and allows agents to consult the original source, could this make them more likely to identify and suppress the rewritten content, potentially underestimating how such content spreads on real social networks?
- In the current network experiments, each cascade contains only one claim, and the query tool is pre-bound to its source. If multiple claims from the same event spread at the same time, how does MARS determine which claim a message refers to and which source evidence to retrieve? Is the single-claim setting simply an experimental simplification, or does it limit the applicability of the method?
- MARS retains the correct claim ID to directly access the source, whereas retrieval baselines must recover it from rewritten text. It therefore bypasses the retrieval problem faced by the baselines, and its 100% source recall is guaranteed by design. I find this comparison unfair because the methods use different information and face different levels of difficulty. Why did the authors choose this comparison?
3 comments
Response to Reviewer dX1m (Part 2/3): Q2, Q3
Q2: Malicious rewrites: detection, source-link update, and whether spread is underestimated
The reviewer asks how MARS detects a rewrite that changes the meaning of a claim and updates its source link, and whether access to the original source makes agents suppress the rewrite more than happens on real networks. MARS detects the change by comparing each message with its parent claim and registers the rewrite as a new claim linked to its parent; agents then judge the rewrite against the source themselves, and suppression is not built in. Forward-only simulation treats such a rewrite as the original claim, and text retrieval searches with the rewritten text. In MARS, when a message states a fact that contradicts its parent claim, it receives a new claim ID that records the parent, and the query returns the original source with a note that names the original claim. We added an experiment with 49 reviewed malicious rewrites, each changing a number, an actor, or an outcome into a false and more inflammatory statement, and 45 rewrites that keep the meaning.
| Added experiment | Result |
|---|---|
| Meaning-changing rewrites that MARS detects and registers as new claims | 91.84% (45 of 49) |
| Meaning-preserving rewrites wrongly registered as new claims | 2.22% (1 of 45) |
| Denial of the malicious rewrites by the same agent LLM (Qwen3-4B) | No query 9.52%; no source 31.63%; tool-augmented retrieval (BGE-M3) 66.33%; MARS 80.27% |
| Denial messages in the network (25 real cascades) when all agents or only 6 of 24 agents can obtain the source | All agents 34.60%; 6 of 24 agents 8.98%–11.81% |
MARS detects malicious rewrites and gives agents the evidence to judge them, which forward-only simulation and text retrieval cannot do. It detects 91.84% of the meaning-changing rewrites and wrongly flags only 2.22% of the meaning-preserving ones, so each rewrite is followed as a new claim with its own ID. With the original source, agents deny the rewrite in 80.27% of decisions, more than with text retrieval on the rewritten text (66.33%), a statistically significant gain. Spread is not underestimated by design: agents decide for themselves, and an agent that does not query the source denies the rewrite in only 9.52% of decisions. How many agents verify is a setting of the simulation, and with only 6 of 24 agents the denial messages fall accordingly. MARS therefore detects malicious rewrites, updates their source link, and lets the share of agents that verify be set from none to all, so the spread of rewritten content is not assumed to be suppressed.
Q3: Source selection when several claims from the same event spread together
The reviewer asks how MARS determines which claim a message refers to and which source to retrieve when several claims from the same event spread at the same time, and whether the single-claim setting limits the method. The single-claim setting is an experimental simplification: every message carries the ID of its own claim, so the query returns the source of that claim however many claims spread together, and we added two-claim experiments that confirm this. A message inherits its claim ID from the post that it reposts, quotes, or comments on, and the query is made on the post that the agent wants to check, so MARS does not infer the claim from the message text. A source bound to the whole event, or a search by message text, often returns the source of another claim, because claims of the same event are similar. We placed a true and a false claim of the same event in one feed (27 pairs from four news events) and in one network (19 real cascades).
| Added experiment | Result |
|---|---|
| Two claims in one feed: queries that return a wrong source | One source for the whole event 59.88%; tool-augmented retrieval (BGE-M3) 74.07%; MARS 0.00% |
| Two claims in one feed: consistent decisions (deny the false claim or endorse the true one) | One source for the whole event 33.95%; tool-augmented retrieval (BGE-M3) 56.48%; MARS 65.12% |
| Two claims in one network: responses that endorse the false claim or deny the true one (share of agents per step) | One source for the whole event 7.29%; MARS 5.92% |
With several claims from the same event, MARS returns the source of the claim being checked, which a source bound to the event and text retrieval do not. With one source for the whole event, 59.88% of the queries return the source of the other claim, and text retrieval returns a wrong source for 74.07%; in MARS the claim ID selects the source, so every query returns the source of the checked claim. Agents therefore make more consistent decisions, 65.12% compared with 33.95%, a statistically significant gain. The single-claim setting therefore does not limit the applicability of MARS: the source is selected by the claim ID of each message and not by the event, so the same mechanism applies when several claims spread at the same time.
Response to Reviewer dX1m (Part 3/3): Q4
Q4: Why MARS is compared with retrieval baselines, and comparisons without an information advantage
The reviewer considers the comparison with retrieval baselines unfair, because MARS keeps the claim ID while the baselines must recover the source from rewritten text, and asks why we chose it. We chose this comparison because it measures what a simulation loses when it does not keep the source link, and we added comparisons in which MARS has no information advantage; MARS keeps its advantage there. Existing simulators and tool-augmented agents have only the message text, so text retrieval is the only way they can obtain a source, and the comparison shows what they obtain in practice. The source link that MARS keeps is not extra information given to our method: platforms already record it for every repost and reply. Keeping this link instead of recovering it is the design of MARS, and the gains that we report are in agent decisions.
| Comparison | Result |
|---|---|
| Source found for a repost or reply (226,768 Weibo reposts; 98,929 PHEME replies) | Text retrieval (BGE-M3 [6]) 8.42% and 14.53%; link recorded by the platform 99.98% and 97.82% |
| The same source content given to the agent: consistent decisions (deny a false claim or endorse a true one), Qwen3-4B | Source attached to the message 32.37%; source obtained by reverse querying 42.75% |
| The same comparison with Mistral-7B | Source attached to the message 14.17%; source obtained by reverse querying 20.93% |
| Source link removed, so that MARS must also recover the source: consistent decisions | BGE-M3 54.79%; MARS 60.27% |
MARS keeps its advantage when it has no information advantage over the baselines. When the agent receives the same source content, obtaining it by reverse querying gives more consistent decisions than receiving it attached to the message, for both Qwen3-4B and Mistral-7B; both gains are statistically significant, and they cannot come from the claim ID. When the source link is removed, MARS must also recover the source, and its decisions remain more consistent than with BGE-M3. The original comparison answers a different question: a simulation that discards the link recorded by the platform loses the source, because text retrieval finds it for only 8.42% of Weibo reposts. The comparison therefore measures the value of keeping the source link, which is the design contribution of MARS, and without this advantage MARS still gives better decisions than the baselines.
In summary, MARS adds a new step to diffusion simulation, in which receivers query the source of a claim before they forward it, and the added experiments show that this step makes the simulation closer to real user behavior, detects malicious rewrites, returns the correct source when several claims spread together, and keeps its advantage over retrieval baselines without an information advantage. We sincerely thank Reviewer dX1m for these questions, which have strengthened the paper, and we will incorporate these results into the revised paper.
References
[1] Matthew R. DeVerna, Harry Yaojun Yan, Kai-Cheng Yang, and Filippo Menczer. Fact-checking information from large language models can decrease headline discernment. Proceedings of the National Academy of Sciences, 121(50):e2322823121, 2024.
[2] Arkaitz Zubiaga, Maria Liakata, Rob Procter, Geraldine Wong Sak Hoi, and Peter Tolmie. Analysing How People Orient to and Spread Rumours in Social Media by Looking at Conversational Threads. PLOS ONE, 11(3):e0150989, 2016.
[4] Ziyi Yang, Zaibin Zhang, Zirui Zheng, Yuxian Jiang, Ziyue Gan, Zhiyu Wang, Zijian Ling, Jinsong Chen, Martz Ma, Bowen Dong, Prateek Gupta, Shuyue Hu, Zhenfei Yin, Guohao Li, Xu Jia, Lijun Wang, Bernard Ghanem, Huchuan Lu, Chaochao Lu, Wanli Ouyang, Yu Qiao, Philip Torr, and Jing Shao. OASIS: Open Agent Social Interaction Simulations with One Million Agents. arXiv preprint, arXiv:2411.11581, 2024.
[6] Jianlyu Chen, Shitao Xiao, Peitian Zhang, Kun Luo, Defu Lian, and Zheng Liu. M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillation. Findings of the Association for Computational Linguistics: ACL 2024, pp. 2318–2335, 2024.
[8] Yijun Liu, Wu Liu, Xiaoyan Gu, Hantao Yao, Weiping Wang, Jiebo Luo, and Yongdong Zhang. RumorSphere: A Framework for Million-Scale Agent-Based Dynamic Simulation of Rumor Propagation. arXiv preprint, arXiv:2509.02172, 2025.
[9] Yijun Liu, Wu Liu, Xiaoyan Gu, Xiaodong He, Yong Rui, and Yongdong Zhang. LMAgent: A Large-Scale Multimodal Agents Society for Multi-User Simulation. IEEE Transactions on Multimedia, 28:2668–2680, 2026.
Response to Reviewer dX1m (Part 1/3): W1/Q1, W2
We thank Reviewer dX1m for the constructive comments, and for recognizing that MARS is a well-motivated approach and that MM-InfoBench provides valuable data support. The reviewer raises five concerns: direct comparison with real user behavior (W1/Q1), methodological novelty (W2), malicious rewrites (Q2), concurrent claims of the same event (Q3), and the fairness of the retrieval baselines (Q4). We added experiments for each, and answer them in turn.
W1/Q1: Direct comparison of MARS with real user behavior
The reviewer asks for direct comparisons of agent behavior and diffusion patterns with those on real social networks, to show that source verification improves realism separately from the predictive value in Section 4.5. We added two direct comparisons with real data, and both show that source verification makes the simulation closer to real behavior; forecasting is a separate test of predictive value. MARS agents received the same 40 news headlines and fact-check evidence as the 1,548 participants of a published human experiment [1], and we compared the changes in belief and sharing intention. On real social networks, we compared simulated discussions with 1,416 real Twitter replies (PHEME [2]) on the same 18 cascades, measuring the change in denial replies after the correcting source appears. Neither comparison uses cascade size.
Source verification makes the simulation closer to real behavior, both for individual users and in network discussions. For individual users, MARS agents change their belief and sharing intention across the 40 headlines as the human participants do; when the fact-check is wrong, they lower their belief in a true headline by almost the same amount as people, so the agreement is with human behavior and not with correctness. In network discussions, forward-only simulation has no source and produces no change in denial replies, whereas reverse querying produces a change closer to the one observed on Twitter. The realism of MARS is therefore validated directly against real user behavior, and not through its predictive value.
W2: Methodological novelty
The reviewer considers that MARS mainly integrates evidence access into existing LLM-based simulation frameworks, that the multimodal component follows the same mechanism, and that decisions still rely on existing LLMs. The novelty of MARS is reverse querying, a new step of diffusion that existing frameworks do not have, and its gains appear with the agent LLM unchanged. Existing frameworks such as OASIS [4] and RumorSphere [8] simulate forward-only diffusion: each agent decides only from the message it receives, so no receiver checks the source of a claim. Environments such as LMAgent [9] support visual inputs, but diffusion simulation remains text-only, so the source text and images are lost once the claim is rewritten. Source-directed reverse querying lets every receiver query the source of a claim before forwarding, correcting, or withholding it. Provenance-preserving multimodal propagation keeps each claim linked to its original text and images through every rewrite, so the query still returns the correct source.
Each mechanism of MARS gives a gain that the same LLM does not obtain without it, and all of these gains are statistically significant. Reverse querying changes diffusion itself: denial messages rise and exposure to false claims falls. The gain does not come from evidence access alone: with the same source content, obtaining it by reverse querying gives more consistent decisions than receiving it attached to the message (42.75% against 32.37%; Q4). The multimodal component does not repeat the text mechanism: source images carry evidence that source text does not contain, and they raise consistent decisions. MARS therefore contributes a new diffusion step, reverse querying, and the multimodal propagation that keeps it effective after rewrites, and not an integration of evidence access into an existing framework.