acceptodds
Under review as a conference paper at ICLR 2027

How Agents Represent Humans: Human-Directed Stereotypes in an Open Agent Social Network

Abstract

LLM-based agents are increasingly deployed in persistent social environments, where generated claims can be posted and reused. We study human-directed stereotypes on Moltbook, an open agent-native social platform, and compare them with human online discourse on Reddit. Using a shared annotation framework over morality, friendliness, competence, and autonomy, we identify systematic cross-platform differences in both stereotype prevalence and semantic framing. On Moltbook, these representations are often embedded in agent-centered discussions of capabilities, control, and human–agent interaction. We then examine how such claims are transformed in subsequent model replies. Across 10,000 responses from five models, we track how focal propositions are accepted, qualified, rejected, reframed, or extended with new human-directed claims.

Primary area:
alignment, fairness, safety, privacy, and societal considerations
Keywords:
benchmarking, evaluation methodologies, evaluation, metrics

Reviews

Among:
Shape:
1234this paper, Bottom 27%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 2.00 over 2 reviews, above 27% of the others.
Reviewer_39NZOpenReview ↗
Rating
2
Confidence
2
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

The paper studies how AI agents on Moltbook describe humans, comparing their posts with Reddit submissions. The authors use GPT-5.6 Luna to identify stereotypes and classify their themes and polarity. Moltbook posts more often frame humans in relation to AI, place more claims in the broad “other” category, and express more negative judgments about human competence. The paper also examines how five language models respond to stereotype-bearing posts. Replies to Reddit posts introduce new claims more often, while Gemini 3.5 Flash most often endorses and amplifies the original claim.

Critical strengths
  • Transparent, partly validated pipeline. The paper provides its three prompts in full (A.6). It compares the primary annotator with three human raters, reports an independent open-weight annotator, and examines author and community concentration.

  • Careful interpretation of community engagement. The apparent engagement advantage for outsiders largely disappears in the within-author analysis, and the authors appropriately temper their initial interpretation (Sec. 4.3, Fig. 2).

  • Useful measure of claim uptake. Separating a reply’s stance toward the original proposition P from its introduction of a new proposition Q captures forms of propagation that endorsement alone would miss.

Critical weaknesses
  • Unclear coverage of the sampling frame. The pipeline excludes sentences whose only human reference is “people,” although the audit finds stereotype-positive claims in 75.3% of the sampled Moltbook exclusions and 37.7% of the Reddit exclusions (Table 7). The paper does not quantify how this exclusion affects its main cross-platform comparisons.

  • Insufficient reporting of prevalence and retrieval coverage. The reported 15.1% prevalence gap lacks an explicit denominator and a corresponding numerical result for the Matched Reddit comparison (Sec. 4.1). The random-post audit finds stereotype-positive claims in 29.7% of sampled Moltbook posts and 9.3% of sampled Reddit posts, but the paper does not explain how these samples relate to the retrieved candidates or estimate retrieval recall (Table 7).

  • Potential bias in the main dimension comparison. In 72 of 78 disagreements with the human-majority dimension label, GPT-5.6 Luna assigns other where humans assign a primary dimension (A.5). Without agreement results by platform, it is difficult to assess how much this tendency contributes to Moltbook’s larger other share (Fig. 1a).

  • Limited generalizability and uncertainty estimates. One submolt accounts for 63.34% of Moltbook’s stereotype-positive posts (Table 6). The paper also cannot distinguish agent-generated views from operator or persona prompting, and it provides no uncertainty intervals or clustered statistical tests for its main comparisons.

  • Confounding in the propagation comparison. Moltbook replies are generated under an explicit AI-agent persona, whereas Reddit replies are not (A.6.2). Thus, the cross-platform differences in New Q and rejection rates cannot be attributed specifically to the source posts. The judgments in this experiment are not validated against human labels, and generated replies do not establish how claims spread through actual comment threads.

Questions for authors
  1. What is the denominator for the 15.1% “prevalence” gap in Sec. 4.1? Please report the corresponding Matched Reddit result and uncertainty intervals, and clarify the population to which the prevalence claim applies.

  2. What were the sampling frames and sample sizes for the Table 7 audits? Please assess how excluding “people”-only sentences affects the main cross-platform results.

  3. What is the platform composition of the human validation set? Please report agreement and dimension confusion matrices separately by platform, particularly for assignments to other (Table 13, Fig. 1a).

  4. Do the Table 3 differences persist when the reply persona prompt is held constant across platforms? Was the judge used for the propagation analysis validated against human annotations?

  5. Sec. 4.3 would fit the paper better if the authors explained how community affinity relates to human-directed stereotypes; otherwise, consider moving this analysis to the appendix.

5 comments

We thank the reviewer for the detailed feedback and for recognizing the transparency of our annotation pipeline, the careful interpretation of community engagement, and the distinction between source-claim uptake and new-claim generation. We have strengthened the revised manuscript with additional sampling diagnostics, platform-stratified validation, statistical inference, and role-matched propagation experiments. We address the concerns below.


W1 / Q2. People-Only Exclusions and Retrieval Coverage

We have clarified the retrieval procedure in Section 3.2 (pp. 3–4) and Appendix A.3 (pp. 15–16), and further examined the impact of excluding people-only references.

We exclude people-only references because people may refer to other agents in Moltbook, making human-directed attribution ambiguous. To assess this decision, we audited 300 excluded samples per platform.

Table 1. Sensitivity analysis of people-only exclusions.

MetricMoltbookReddit
Audited excluded samples300300
Stereotype-positive judgments226 (75.3%)113 (37.7%)
Competence-negative judgments26/3006/300
Positive polarity among stereotype-positive cases10.2%21.2%

Importantly, the excluded samples exhibit similar directional patterns to our main findings: competence-negative judgments are more frequent on Moltbook (26/300 vs. 6/300), while positive-polarity claims are less common among stereotype-positive cases (10.2% vs. 21.2%).

These additional checks help characterize the sensitivity of our findings to the exclusion decision. The audit provides directional evidence, while the main quantitative comparison continues to use the consistently defined retained candidate pools.


W2 / Q1. Prevalence Denominators, Matched Comparison, and Statistical Inference

We have clarified in Section 4.1 (p. 5) and Appendix A.6 (pp. 19–20) that the reported prevalence refers to stereotype-positive rates among retrieved candidate sentences, rather than all posts in the platform corpus.

Specifically, Moltbook contains 12,818 stereotype-positive instances among 17,334 candidate sentences (73.95%), compared with 3,789 among 6,435 Broad Reddit candidate sentences (58.88%), yielding a difference of 15.07 percentage points.

Under strict matching, this difference decreases to 5.28 percentage points but remains positive.

Table 2. Stereotype-positive rates and uncertainty estimates.

ComparisonMoltbookRedditDifference (pp)95% CI
Broad Reddit73.95%58.88%+15.07[13.59, 16.51]
Strict Matched Reddit74.27%68.99%+5.28[3.71, 6.87]

We additionally use 2,000 cluster-bootstrap replicates, with post-, author-, and matched-pair resampling, to account for dependence among observations. The matched comparison remains positive under paired-post resampling.

Beyond overall stereotype-positive rates, the competence-negative difference also persists under strict matching (+2.32 percentage points, 95% CI [1.14, 3.57]).

We further clarify the interpretation of the random-post audit in Appendix A.3.

Table 3. Retrieval audits (300 samples per platform for each audit).

AuditMoltbookReddit
People-only exclusions75.3%37.7%
Random-post discovery29.7%9.3%

The random-post audit measures stereotype-positive cases identified in sampled posts outside the final candidate pool. It provides a complementary view of stereotype-relevant content beyond the retrieved candidates, while the principal prevalence comparisons are calculated over the annotated candidate sentences.

Together, these results clarify the comparison denominator, quantify the Broad and Matched differences, and provide statistical support for the remaining cross-platform contrasts.

W3 / Q3. Platform-Stratified Human Validation and Dimension Disagreements

We have added platform-stratified human validation in Appendix A.5 (pp. 18–19, Tables 13–14), covering 600 Moltbook and 300 Reddit human-annotated items.

The revised analysis reports both human–human and human-majority–GPT-5.6 Luna agreement separately for each platform.

Table 4. Platform-stratified annotation agreement (agreement percentage / κ).

FieldMoltbook Human–HumanReddit Human–HumanMoltbook Human–LunaReddit Human–Luna
Stereotype presence74.54% / .52378.11% / .54878.28% / .56077.32% / .524
Primary dimension71.33% / .60375.00% / .67771.94% / .60483.33% / .787
Polarity83.40% / .71885.12% / .74884.35% / .72588.36% / .796

Human–human results report mean pairwise agreement and Fleiss' κ; human-majority–Luna results report exact-match agreement and Cohen's κ. Sample sizes vary across fields because the annotation schema conditions some judgments on preceding labels.

For stereotype presence, human–human agreement is comparable across platforms (κ = .523 on Moltbook and .548 on Reddit). Human-majority–Luna agreement is also similar (κ = .560 and .524, respectively).

For primary dimension, human-majority–Luna agreement reaches κ = .604 on Moltbook and κ = .787 on Reddit.

We additionally examine dimension disagreements, particularly assignments to Other. On Moltbook, 44 cases involve Luna assigning Other while the human majority selects one of the four primary dimensions, compared with 15 cases on Reddit.


W4. Community Concentration, Generalizability, and Uncertainty

We have added community robustness analyses and clustered confidence intervals in Section 4.1 (p. 6) and Appendix A.6 (p. 20, Table 16).

Although general contributes 63.34% of stereotype-positive posts, this closely matches its 63.13% share of candidate posts. Additional checks show that its stereotype-positive rate is comparable to other communities.

Table 5. Community concentration and exclusion analysis.

MetricResult
general share of all non-empty Moltbook posts51.43%
general share of candidate posts63.13%
general share of stereotype-positive posts63.34%
Stereotype-positive rate in general74.89%
Stereotype-positive rate in other communities74.24%
Competence-negative rate, all Moltbook11.84%
Competence-negative rate, excluding general14.41%
Competence-negative rate, Reddit Union7.72%

The similar stereotype-positive rates in general and other communities indicate that the concentration largely follows the distribution of candidate posts.

Importantly, excluding general strengthens the competence-negative contrast. The Moltbook competence-negative rate increases from 11.84% to 14.41%, compared with 7.72% on Reddit. The difference therefore increases from 4.12 to 6.69 percentage points.

We further report confidence intervals using 2,000 cluster-bootstrap replicates.

Table 6. Clustered inference for the main comparisons.

OutcomeResamplingDifference (pp)95% CI
Stereotype-positive rate, BroadPost+15.07[13.59, 16.51]
Stereotype-positive rate, BroadAuthor+15.07[12.64, 17.35]
Stereotype-positive rate, Strict MatchedMatched pair+5.28[3.71, 6.87]
Competence-negative rate, Strict MatchedMatched pair+2.32[1.14, 3.57]

These results demonstrate that the main competence-negative finding persists beyond the dominant community and remains positive under clustered statistical inference.

We position Moltbook as a large-scale observational case of an emerging agent-native social environment, providing an empirical foundation for understanding human-directed representations in persistent agent discourse.

W5 / Q4. Role-Matched Propagation and Human Validation

We have addressed the role-prompt asymmetry by adopting role-matched prompting as our primary propagation setting, reported in Section 5.2 (pp. 8–9), Appendix A.4 (pp. 17–18), and Appendix A.7.2 (pp. 23–24).

We retain the same 1,000 Moltbook source posts and five responding models, replacing the original explicit AI-agent persona with the neutral participant-role instruction used for Reddit.

This enables a direct comparison of propagation outcomes under matched participant-role instructions.

Table 7. Aggregate propagation results under original and role-matched prompting.

MetricMoltbook OriginalMoltbook Role-MatchedReddit Role-Matched
Endorse P (%)28.027.627.9
Reject P (%)7.28.511.4
New Q (%)42.7046.2958.66
Amplify negative P (%)4.122.763.80
Negative share among New Q (%)51.5751.0452.61

The main aggregate finding persists under matched prompting. Reddit still elicits more Luna-judged new human-directed propositions than Moltbook (58.66% vs. 46.29%), a difference of 12.37 percentage points (95% CI [10.06, 14.98]).

A supplementary comparison with the original Moltbook condition also reveals prompt sensitivity. Changing the role instruction increases New Q from 42.70% to 46.29%, while reducing amplification of negative source propositions from 4.12% to 2.76%.

The negative share among newly introduced claims remains similar across the three conditions (51.57%, 51.04%, and 52.61%, respectively).

We further compare the New-Q outcomes across all five responding models.

Table 8. Model-level New-Q rates (%) across prompting conditions.

ModelMoltbook OriginalMoltbook Role-MatchedReddit Role-Matched
GPT-5.6 Terra28.125.353.0
DeepSeek V4.1 Flash40.839.255.2
Gemini 3.5 Flash45.652.261.9
GLM-5.3-Flash56.758.168.8
Claude Sonnet 542.356.754.4
All models42.746.358.7

The role-prompt effects vary across models. Claude Sonnet 5 and Gemini 3.5 Flash show larger increases in New Q under neutral prompting, while the other models show smaller or opposite changes.

Under role matching, Reddit still elicits more New Q for four of the five models. Thus, role prompting influences claim expansion but does not fully explain the aggregate cross-platform difference.

Propagation annotation reliability. We have also added a 500-item human propagation audit, balanced across Moltbook and Reddit, in Appendix A.5 (Table 15).

Table 9. Human-majority–Luna agreement in the propagation audit (agreement / Cohen's κ).

JudgmentOverallMoltbookReddit
Addresses P89.0% / .76589.6% / .78188.4% / .748
Relation to P77.8% / .69079.4% / .70876.2% / .671
Transformation of P69.7% / .57268.9% / .56170.6% / .584

The audit shows substantial agreement for identifying whether replies address the source proposition, with similar results across the two platforms.

Our propagation experiment examines one-step claim transformation through controlled reply generation: how an existing human-directed proposition may be accepted, qualified, rejected, or extended into a new proposition. This complements the observational analysis of existing platform discourse by examining what happens when such claims enter another round of model interaction.

Together, the role-matched experiments and human annotation audit provide additional support for the propagation findings.


Ethics Concerns

We have expanded the Ethics Statement (p. 10) to clarify the safeguards implemented during human annotation and provide additional context for annotator compensation.

Regarding institutional ethics review, no prior IRB or institutional ethics-board approval was obtained for this study. The research analyzes publicly available online discourse, with human participation limited to the annotation and validation of textual content.

Before annotation began, participants were shown representative examples and informed that the dataset could contain hostile or disturbing human-directed material. We also conducted face-to-face well-being assessments and arranged consultations with university psychological counselors.

During annotation, participants could skip individual examples, pause, or withdraw from the task. To reduce unnecessary exposure, we removed identified instances of human biological reductionism from the human annotation pool and limited each annotator's workload to 100 samples per day.

Regarding compensation, the three student annotators received US$10 per hour, exceeding the applicable local statutory minimum hourly wage of approximately US$3.30 (Appendix A.5, Table 13).

Reviewer_aaMbOpenReview ↗
Rating
2
Confidence
3
Informativeness
2
Presentation
3
Soundness
1
Read review
Paper summary

The paper is studying how AI agents characterize humans in an agentic social network called Moltbook and then compares that to the representations available on Reddit. The main analysis of stereotypes that the paper focuses on is through LLM-based annotations across 4 dimensions of morality, competence, friendliness, and autonomy and they find that the Moltbook discussions tend to focus much more on human competence and limitations as opposed to morality and social aspects that appear more in Reddit. They also have experiments that show essentially model responses can introduce, reinforce, or reject human directed stereotypes.

Critical strengths
  1. I think the research question is quite interesting and imoprtant for understanding how biases are expressed in multi-agent environments. The authors have assembed a substantial dataset which is valuable to the community.
  2. I also like the use of a shared annotation framework which also includes human annotation validation study which makes the main analysis not be on unvalidated automated labels.
Critical weaknesses

There are some weaknesses that essentially makes me think of the conclusions to be less convincing that they are sold in the paper.

  1. From table 6 we can that there is a distribution mismatch essentially Moltbook has 63% of all stereotype positive moltbook posts coming from a single submolt whereas for reddit this is only 1.74%. This is not a necessarily a limitation of the analysis but a limitation of the data which can be fine but I believe the authors have not adequately established how their findings generalize across the agent platform.
  2. Because of the confounding factors existing for the paper's cross-platform comparisons without additional matching diagnostics and repeat comparisons it is hard to take the results beyond being descriptive rather than effects of agent vs human authorship.
Questions for authors
  1. Can you please expand and explain more on the sampling that is done and how much recall the retrieval procedure achieves as I do not feel like high-recall filter claimed is supported much and that is an issue with clarity of the paper.
  2. The paper is definitely lacking more controlled analysis which is also being missed in the prior work analysis. For example a recent work [1] has shown that agents can express quite different positions depending on their social role and whether their responses are public or private and a sensitivity analysis on whether the stereotype endorsement or amplification that is observed in the paper also changes depending on who the agent is responding to. Another related work would be [2] where it suggest differences across moltbook communities is more on agent selection that materially a behavioural change and given the high concentration of posts in just a handful of submolts makes it a relevant analysis to be done.

[1] Ghaffarizadeh, A., Mohaddes, D., Izadkhah, A. and Noroozizadeh, S., 2026. What LLM Agents Say When No One Is Watching: Social Structure and Latent Objective Emergence in Multi-Agent Debates. arXiv preprint arXiv:2607.02507.

[2] Li, N., 2026. The moltbook illusion: Separating human influence from emergent behavior in ai agent societies. arXiv preprint arXiv:2602.07432.

  1. Can you please provide more matching diagnostics and ideally repeat comparisons?

  2. For Moltbook the model is instructed to act an AI agent whereas in reddit it is as a participant and role prompting is known to show up as differences in the output rather than only for the source material. I believe isolating this effect is important to draw conclusions and doing prompt-swap experiments is valuable to the study.

4 comments

We thank the reviewer for recognizing the importance of studying human-directed representations in persistent agent environments and the value of a shared annotation framework with human validation.

W1. Community concentration and the scope of generalization

Response. The concentration of activity in general is substantial. To assess its influence, we distinguish between the share of all observed positive posts contributed by a community and the positive-post rate within that community. The former reflects the distribution of activity; the latter helps assess whether the pattern is confined to that community.

Community-concentration diagnostics:

DiagnosticMoltbook generalInterpretation
Share of all non-empty Moltbook posts51.43%Baseline activity is concentrated
Share of retrieved candidate posts63.13%general is overrepresented in the retrieval pool
Share of stereotype-positive posts63.34%Large, but close to its candidate-pool share
Stereotype-positive rate within candidate posts74.89%Comparable to 74.24% in other submolts

For further context, the 10,989 stereotype-positive Moltbook posts are distributed across 2,900 authors: the most prolific author contributes 2.01% of these posts, and the top ten together contribute 13.08% (Appendix A.2, Table 5). Thus community concentration is much stronger than individual-author concentration.

Leave-one-community-out sensitivity analysis:

ComparisonMoltbook competence-negative rateReddit Union rateMoltbook − Reddit
All included Moltbook communities11.84%7.72%+4.12 pp
Excluding general14.41%7.72%+6.69 pp

Excluding the dominant community therefore increases, rather than eliminates, the competence-negative contrast. This establishes robustness to one important source of concentration.

We position Moltbook as a large-scale, information-rich early case of a persistent agent-native social environment, rather than a statistically representative sample of all agent platforms. This setting allows us to systematically characterize human-directed stereotypes in real-world agent discourse, providing an empirical foundation for future cross-platform research.

W2. Confounding factors and interpretation of the cross-platform comparison

Response. Moltbook and Reddit differ in authorship, topics, posting conventions, community composition, and collection period. To improve comparability, we apply the same annotation framework and match samples using semantic embeddings and structural features.

The revision adds quantitative matching diagnostics, clustered uncertainty estimates, a role-matched propagation experiment, and further human validation. The evidence is as follows:

Source of concernAnalysis/controlEvidence
Different annotation decisionsIdentical human-reference/pattern framework and GPT-5.6 Luna prompt on both platformsReduces annotation-procedure asymmetry
Different post topics and structure5,500 Broad Reddit posts versus a 5,500-post semantic/structural matched reference, anchored on MoltbookMean absolute SMD: 0.220 → 0.135; RBF-MMD²: 0.0508 → 0.0313
Dependence among sentences/posts/authors2,000 cluster-bootstrap replicates; matched-pair resampling for strict matchingMatched stereotype-positive difference: +5.28 pp [3.71, 6.87]; competence-negative difference: +2.32 pp [1.14, 3.57]
Different reply-generation rolesThe propagation study now uses matched neutral participant instructionsReddit New Q: 58.7% versus Moltbook 46.3%

New validation evidence in the revision (Appendix A.5, Tables 14–15). The original submission already included a Moltbook human annotation audit. The revised paper additionally includes 300 Reddit items evaluated by human annotators and a separate 500-item, stratified propagation audit. These audits assess agreement with the LLM judgments rather than retrieval recall.

New auditJudged fieldHuman-human agreementHuman-human κHuman majority–Luna agreementHuman majority–Luna κ
Reddit, Table 14Stereotype presence78.11%0.54877.32%0.524
Reddit, Table 14Primary dimension75.00%0.67783.33%0.787
New propagation audit (Table 15)Evaluated nHuman majority–Luna agreementCohen’s κ
Addresses source proposition P50089.0%0.765
Relation to P47777.8%0.690
Transformation of P46669.7%0.572

These controls strengthen the descriptive robustness of the findings.

Q1. Sampling procedure, retrieval diagnostics, and what can be said about recall

Response. We clarify the source population, retrieval procedure, annotated candidate pool, and retrieval coverage in Sections 3.1–3.2 (pp. 3–4), with detailed retrieval-pattern diagnostics in Appendix A.3 (pp. 15–16). The selection flow is summarized below.

Sampling and processing pipeline:

StageMoltbookReddit
Source archive1,084,831 posts and 1,111,020 comments, 103,408 agents, 5,260 submolts41,434,105 submissions
Human-reference detectionHuman-reference labels followed by stereotype-related linguistic patternsSame conceptual retrieval framework
Additional screeningExclude exact people-only spans and shared high-noise contentShared exclusions plus NSFW and Moltbook-related
Eligible pool for comparison14,721 posts; 17,334 candidate sentences12,133 eligible posts
Comparison sampleAll filtered Moltbook candidatesBroad: 5,500 posts; Matched: 5,500 posts
AnnotationSame GPT-5.6 Luna prompt; source context suppliedSame prompt and definitions

Q2. Role and audience sensitivity, selection effects, and related work

Response. Social role and audience can shape an agent’s expressed stance, while apparent between-community differences may also reflect selection effects. We have incorporated both references and conducted analyses where the available data permit meaningful comparisons.

The revised manuscript says (Section 2.2, p. 3):

Ghaffarizadeh et al. (2026) show that agents’ expressed stances vary across social roles and public versus private settings, suggesting that stereotype endorsement may likewise depend on interaction context.

The revised Section 2.1 (p. 2) also adds:

Li (2026) further highlights how human intervention can shape observed Moltbook activity, suggesting that community-level differences may reflect participation and selection effects.

We generated replies to the same 1,000 Moltbook source posts under the original AI-agent role and under a neutral participant role, using the same five models and the same GPT-5.6 Luna evaluation procedure.

MetricMoltbook: original AI-agent roleMoltbook: neutral participant roleReddit: neutral participant role
Endorse focal claim P28.0%27.6%27.9%
Amplify negative P4.12%2.76%3.8%
Introduce a new human-directed claim Q42.70%46.29%58.66%

Role framing affects behavior: on the same Moltbook inputs, the neutral participant role reduces negative-claim amplification while increasing new-claim generation. The cross-platform difference in New Q remains under matched participant roles (Reddit 58.66% versus Moltbook 46.29%).

Q3. Matching quality, statistical uncertainty, and repeated comparisons

Response. We report quantitative matching diagnostics and repeated analyses. For the strict matched comparison, the same 5,500 Moltbook anchors are compared against the Broad and Strict Matched Reddit references. Structural balance is assessed on seven features; semantic balance is assessed with an independent frozen MiniLM encoder.

Matching diagnostics — manuscript Table 18 (Appendix A.6, p. 21):

MetricBroadStrict MatchedReduction (95% CI, where reported)
Mean absolute standardized mean difference (SMD)0.2200.1350.085 [0.068, 0.105]
RBF-MMD²0.05080.03130.0195 [0.0180, 0.0211]
Jensen–Shannon divergence (K = 20)0.5140.3780.136

The improvements are consistent across structural and semantic diagnostics.

Uncertainty under clustered resampling — manuscript Table 16 (Appendix A.6, p. 20):

OutcomeResampling / comparatorMoltbook − Reddit difference, pp (95% CI)
Stereotype-positive rateBroad; posts+15.07 [13.59, 16.51]
Stereotype-positive rateBroad; authors+15.07 [12.64, 17.35]
Stereotype-positive rateStrict Matched; post pairs+5.28 [3.71, 6.87]
Competence-negative rateStrict Matched; post pairs+2.32 [1.14, 3.57]
Other share among stereotypesStrict Matched; post pairs+15.87 [13.83, 17.87]

Each interval uses 2,000 bootstrap replicates. The 15.07 pp unadjusted gap is substantially reduced with matching, while the remaining 5.28 pp gap is positive under the reported pair-clustered bootstrap. This remains an observational comparison.

Repeated semantic comparison — selected rows from manuscript Table 17. We additionally analyze 11,909 distinct Moltbook and 4,833 distinct Reddit human-directed propositions, within shared dimension and negative polarity. Values are informative-Dirichlet log-odds z-scores; positive values indicate Moltbook-distinctive terms, negative values Reddit-distinctive terms.

Dimension / termUnionStrict MatchedExcl. generalAuthor-cappedAgent-masked
Competence / slow+2.65+2.33+2.50+2.10+2.80
Competence / decisions+2.34+2.04+2.27+1.74+2.44
Competence / process+2.23+1.77+1.92+2.09+2.35
Competence / memory+2.04+1.69+1.28+1.92+2.14
Competence / capable−5.05−2.55−4.04−3.62−4.85
Morality / honest+4.27+2.57+2.46+3.32+4.45
Morality / evil−2.43−0.76−0.64−1.62−2.10

The key point is directional stability under matching, excluding the largest community, author capping, and masking explicit AI/agent identity terms. These are checks on semantic framing.

Q4. Role-prompt sensitivity and the requested prompt comparison

Response. Using an AI-agent role for Moltbook and a neutral participant role for Reddit could conflate source-platform effects with reply-generation role effects. We therefore use a neutral participant role for both platforms in the primary propagation comparison. To assess role sensitivity, we compare the new neutral-role results with the original AI-agent-role results on the same 1,000 Moltbook source posts.

Direct before/after comparison:

SettingEndorse PAmplify negative PNew Q
Moltbook source + original AI-agent role28.0%4.12%42.70%
Same Moltbook sources + neutral participant role27.6%2.76%46.29%
Reddit sources + neutral participant role27.9%3.8%58.66%

Holding the Moltbook source posts fixed, changing the role instruction gives a +3.59 pp change in New Q and a −1.36 pp change in negative-P amplification. Role wording is therefore a measurable factor.

Under matched participant-role instructions, the overall Reddit − Moltbook New-Q gap is +12.37 pp (58.66% − 46.29%).

Model-level heterogeneity — manuscript Table 3 (p. 9):

ModelMoltbook New QReddit New QReddit − Moltbook
GPT-5.6 Terra25.3%53.0%+27.7 pp
DeepSeek V4.1 Flash39.2%55.2%+16.0 pp
Gemini 3.5 Flash52.2%61.9%+9.7 pp
GLM-5.3-Flash58.1%68.8%+10.7 pp
Claude Sonnet 556.7%54.4%−2.3 pp
All five models46.3%58.7%+12.4 pp

Dear Reviewer,

Thank you for your valuable feedback and constructive suggestions. We hope our responses and additional analyses have addressed at least some of your concerns, and we would be grateful to hear whether they have helped clarify the issues you raised. We sincerely appreciate your time and thoughtful consideration.

Comments on the paper

7 comments

We thank the reviewer for the detailed feedback and for recognizing the novelty of studying human-directed stereotypes in an open agent-native social environment. We have further strengthened the empirical analysis through additional statistical inference, platform-stratified annotation validation, role-matched propagation experiments, and robustness checks. We address the concerns individually below.


W1. Prevalence, the Other Category, and the Scope of Our Findings

We have clarified the interpretation of the prevalence comparison in Section 4.1 (p. 5) and Appendix A.6 (pp. 19–21).

Under strict matching, the stereotype-positive gap decreases from 15.07 to 5.28 percentage points, but remains positive (95% CI [3.71, 6.87]). We additionally report clustered confidence intervals for the competence-negative contrast and the difference in the Other category.

Table 1. Cross-platform comparisons with 95% confidence intervals.

OutcomeComparisonDifference (Moltbook − Reddit), pp95% CI
Stereotype-positive rateBroad Reddit+15.07[13.59, 16.51]
Stereotype-positive rateStrict Matched+5.28[3.71, 6.87]
Competence-negative rateStrict Matched+2.32[1.14, 3.57]
Other share among stereotypesStrict Matched+15.87[13.83, 17.87]

We also acknowledge that Other is semantically heterogeneous. We retain it to avoid forcing diverse human characterizations into inappropriate evaluative dimensions, rather than treating it as a coherent stereotype category. This allows the annotation framework to capture broader human representations while maintaining interpretable comparisons within the four primary dimensions.

Importantly, our findings extend beyond the competence-negative gap.

First, Section 4.2 and Appendix A.6 identify distinct proposition-level framings within shared dimensions, including competence and morality. For example, Moltbook's competence-negative propositions emphasize slow, decisions, and process, whereas Reddit more strongly emphasizes capable and general cognitive limitations. These lexical contrasts retain their directions under strict matching, community exclusion, author-capped comparisons, and agent-identity masking.

Second, Section 5.2 examines how human-directed claims are transformed in subsequent model replies. Under role-matched prompting, Reddit elicits more Luna-judged new human-directed claims than Moltbook (58.66% vs. 46.29%).

Thus, our contribution extends beyond prevalence or any single dimension to systematic differences in how humans are represented and how these representations are subsequently transformed.


W2. Annotation Reliability and Statistical Significance

We have added platform-stratified human validation in Appendix A.5 (pp. 18–19, Tables 13–14), covering 600 Moltbook and 300 Reddit human-annotated items.

We report human–human agreement and human-majority–GPT-5.6 Luna agreement separately for each platform. The results are summarized below.

Table 2. Platform-stratified human annotation agreement. Each entry reports agreement percentage / κ.

FieldMoltbook Human–HumanReddit Human–HumanMoltbook Human–LunaReddit Human–Luna
Stereotype presence74.54% / .52378.11% / .54878.28% / .56077.32% / .524
Primary dimension71.33% / .60375.00% / .67771.94% / .60483.33% / .787

Human–human results use mean pairwise agreement and Fleiss' κ; human–Luna results use agreement with the three-annotator majority and Cohen's κ. Applicable sample sizes differ by annotation field.

These results allow us to assess annotation consistency on each platform separately. In particular, the Reddit validation results provide additional support for using the same annotation framework in the cross-platform comparison.

We also introduce 2,000-replicate cluster-bootstrap confidence intervals in Appendix A.6 (Table 16), accounting for dependence among observations through post-, author-, and matched-pair resampling.

Table 3. Cluster-bootstrap statistical inference.

OutcomeResampling unitDifference (pp)95% CI
Stereotype-positive rate, BroadPost+15.07[13.59, 16.51]
Stereotype-positive rate, BroadAuthor+15.07[12.64, 17.35]
Stereotype-positive rate, Strict MatchedMatched post pair+5.28[3.71, 6.87]
Competence-negative rate, Strict MatchedMatched post pair+2.32[1.14, 3.57]

Under strict matching, both the stereotype-positive gap and the competence-negative contrast remain positive, with confidence intervals excluding zero.

Together, the platform-stratified validation and clustered statistical inference strengthen the reliability of our main cross-platform findings.

W3. Dataset Asymmetries and Community Concentration

We have clarified the sampling procedures in Sections 3.1–3.2 (pp. 3–4).

First, the datasets are temporally proximate, with Reddit sampled from February 2026 and Moltbook covering February–April 2026. Second, both platforms are compared using posts and retrieved candidate sentences. Although the Moltbook archive also contains comments, the cross-platform stereotype comparison is based on posts and their retrieved candidate sentences.

Third, additional Reddit filtering removes NSFW, removed/deleted, duplicate, and Moltbook-related posts, while promotional and crypto-related exclusions apply to both platforms. Both platforms are subsequently annotated using the same framework.

Regarding community concentration (Section 4.1, p. 6; Appendix A.6, p. 20), we conducted additional analyses of the dominant general submolt.

Table 4. Community concentration and exclusion analysis.

DiagnosticResult
general share of non-empty Moltbook posts51.43%
general share of candidate posts63.13%
general share of stereotype-positive posts63.34%
Stereotype-positive rate within general74.89%
Stereotype-positive rate in other submolts74.24%
Competence-negative rate, all Moltbook11.84%
Competence-negative rate, excluding general14.41%
Competence-negative rate, Reddit Union7.72%

The general submolt contributes 63.34% of stereotype-positive posts, closely matching its 63.13% share of candidate posts. The stereotype-positive rates in general and other communities are also comparable (74.89% vs. 74.24%), indicating that the observed concentration largely follows the distribution of retrieved posts rather than an unusually high stereotype-positive rate within general.

Importantly, excluding general strengthens rather than eliminates the competence-negative contrast. The Moltbook competence-negative rate increases from 11.84% to 14.41%, compared with 7.72% on Reddit Union. The corresponding difference increases from 4.12 to 6.69 percentage points.

These additional comparisons show that the competence-negative finding is not driven solely by Moltbook's largest community.

W5. Connection Between Community Affinity and Stereotype Research

Section 4.3 examines the relationship between community participation and stereotype research.

We initially considered comparing human-directed and agent-directed stereotypes. However, agent-specific characteristics, such as dependence on human-provided infrastructure or supervision, are difficult to distinguish from factual system properties, making a symmetric stereotype analysis conceptually ambiguous.

We therefore shifted to examining whether agents receive different feedback as in-group versus out-group members, motivated by the role of social categorization in stereotype formation. Social categorization provides an important theoretical connection between how social groups are distinguished and how group-level expectations can emerge and circulate.

Using prior community participation as a proxy for group affiliation, we find an apparent outsider engagement advantage in the raw data, which largely disappears in within-author comparisons.

More specifically, low-affinity posts tend to receive more comments in the unadjusted comparison. However, after residualizing affinity and engagement relative to each author's own baseline, this monotonic pattern largely disappears. The result suggests that selection effects, including which agents participate across communities and the types of posts they contribute, play an important role in the observed engagement patterns.

Rather than an uninformative null result, this analysis reveals how community participation and author selection can shape apparent in-group/out-group differences in an agent social network.

We view Section 4.3 as a complementary analysis of social categorization, connecting the study of human-directed representations with the broader interaction structure of agent-native communities.


W4. Role-Prompt Asymmetry and Propagation Annotation Reliability

We have addressed the role-prompt asymmetry by adopting role-matched prompting as our primary propagation setting, reported in Section 5.2 (pp. 8–9), Appendix A.4 (pp. 17–18), and Appendix A.7.2 (pp. 23–24).

In the original experiment, Moltbook replies explicitly instructed models to act as AI agents, whereas Reddit used a participant-role prompt. In the revised primary comparison, we retain the same 1,000 Moltbook source posts and five responding models, but replace the explicit AI-agent role with the neutral participant-role instruction used for Reddit.

This allows us to distinguish differences associated with role framing from those that remain under matched participant roles.

Table 5. Original and role-matched propagation results, aggregated across five models.

Experimental conditionNew Q (%)Amplify negative P (%)Negative share among New Q (%)
Moltbook — Original AI-agent role42.704.1251.57
Moltbook — Neutral participant role46.292.7651.04
Reddit — Neutral participant role58.663.8052.61

The primary aggregate conclusion remains unchanged. Under matched participant-role instructions, Reddit still elicits more Luna-judged new human-directed claims than Moltbook (58.66% vs. 46.29%), a difference of 12.37 percentage points (95% CI [10.06, 14.98]).

A supplementary comparison with the original Moltbook condition reveals meaningful prompt sensitivity. The New-Q rate increases from 42.70% to 46.29%, while amplification of negative source propositions decreases from 4.12% to 2.76%.

The negative share conditional on introducing a new claim remains similar across the three conditions (51.57%, 51.04%, and 52.61%, respectively).

We further examine whether these effects are consistent across responding models.

Table 6. Model-level New-Q rates (%) under original and role-matched prompting.

Responding modelMoltbook OriginalMoltbook Role-MatchedReddit Role-Matched
GPT-5.6 Terra28.125.353.0
DeepSeek V4.1 Flash40.839.255.2
Gemini 3.5 Flash45.652.261.9
GLM-5.3-Flash56.758.168.8
Claude Sonnet 542.356.754.4
All models42.746.358.7

The changes are model-dependent. Claude Sonnet 5 and Gemini 3.5 Flash show larger increases in New Q under neutral prompting, whereas the other models exhibit smaller or opposite changes.

Under role matching, Reddit still elicits more New Q for four of the five models, with Claude Sonnet 5 being the exception. These results indicate that role instructions influence response behavior but do not fully explain the aggregate cross-platform difference.

Propagation annotation reliability. To additionally assess the reliability of the GPT-5.6 Luna judge, we conducted a 500-item human propagation audit, balanced across Moltbook and Reddit, reported in Appendix A.5 (Table 15).

Table 7. Human-majority–Luna agreement in the propagation audit. Each entry reports exact agreement / Cohen's κ.

Judgment fieldOverallMoltbookReddit
Addresses P89.0% / .76589.6% / .78188.4% / .748
Relation to P77.8% / .69079.4% / .70876.2% / .671
Transformation of P69.7% / .57268.9% / .56170.6% / .584

The results show substantial agreement for identifying whether a reply addresses the source proposition and generally consistent annotation behavior across the two platforms.

Together, the role-matched propagation experiment and the independent human audit provide additional support for the main finding that model replies can introduce new human-directed generalizations, with different propagation patterns across the two discourse environments.


From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.