acceptodds
Under review as a conference paper at ICLR 2027

CrossBot: Drift-Decoupled Adaptation for Cross-Domain Social Bot Detection

Abstract

Cross-domain social bot detection suffers from substantial performance degradation due to differences in user behaviors, platform characteristics, and bot-generation strategies. Existing unsupervised domain adaptation methods generally model such variations as a single domain discrepancy and apply uniform alignment, which may remove class-discriminative cues or preserve unreliable source decisions. We propose Drift-Decoupled Domain Adaptation (DDDA), a framework that decomposes cross-domain drift into representation-level style drift and decision-level drift. For style drift, DDDA introduces a class-conditional contrastive style alignment mechanism that reduces domain-specific expression differences while preserving discriminative information. For decision drift, DDDA develops a transferability-guided routing mechanism that estimates source decision reliability on unlabeled target domains and adaptively selects appropriate transfer strategies. Extensive experiments on three cross-domain social bot detection datasets demonstrate that DDDA consistently improves target-domain generalization over existing adaptation methods. Further analysis reveals diverse drift patterns across domains, highlighting the importance of drift-aware adaptation.

Primary area:
transfer learning, meta learning, and lifelong learning
Keywords:
Cross-Domain Social Bot Detection, Unsupervised Domain Adaptation, Distribution Shift, Transferability, Contrastive Learning

Reviews

Among:
Shape:
1234this paper, Bottom 2%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 1.33 over 3 reviews, above 2% of the others.
Reviewer_9ZLoOpenReview ↗
Rating
2
Confidence
2
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

This paper targets cross-domain social bot detection. It proposes decoupling cross-domain drift into "representation-level style drift" and "decision-level drift", and handling them with class-conditional contrastive style alignment and transferability-guided routing, respectively.

Critical strengths

The motivation is intuitive and addresses an important practical challenge in cross-domain social bot detection. The experimental evaluation covers a relatively broad range of baselines.

Critical weaknesses
  1. The paper introduces three statistical metrics to characterize the shape of the target-domain prediction distribution, yet this distribution does not reflect prediction correctness. The treatment of the three metrics is also rather simplistic, offering only limited evidence of effectiveness without any in-depth analysis.
  2. DDDA achieves the best results only on BotSim24 in Table 2. On the other two target domains, removing the core components actually performs better. This result cannot demonstrate the effectiveness of the proposed modules.
Questions for authors
  1. Some of the paper's core claims are not supported by relevant experiments. For example, the paper claims that z_R − z_G represents a domain-specific style, which would require analyzing what this residual actually contains.
  2. The method proposed by the authors is multi-source, but the main experiments all provide data from two domains and test on a single target domain. This is far from "multi".
  3. In Table 1, the backbones used across all the models are inconsistent, and it is not immediately clear which results are comparable.
Reviewer_gLcWOpenReview ↗
Rating
1
Confidence
3
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

The paper proposes Drift-Decoupled Domain Adaptation (DDDA), a method that addresses domain adaptation for the task of social bot detection through decoupling the cross-domain drift into a style-level drift and a decision-level drift and tackling each separately. Under this paper's evaluation on three different bot detection datasets in a leave-one-out protocol, the proposed method shows improved accuracy and macro-F1 on all three adaptation tasks compared to the existing adaptation methods included in the comparison.

Critical strengths

Strengths - The paper tackles domain adaptation under a very different setting from the traditional image classification or detection that's typically the focus in similar papers. The unique data and challenges of the mostly textual input compared to images make effective adaptation methods different from the dominant approaches in the field which are developed for visual tasks. I think the author's transferability guided routing mechanism, using prediction separation, prediction variation, and prediction margin based on the semantic and behavioral channels routing to the three different transfer strategies (direct transfer, behavioral transfer, and semantic adaptation) is interesting and novel as a method.

Critical weaknesses

Weaknesses - While I find the method itself interesting, the corresponding evaluation protocol, experimental results, and general methodological analysis in the paper I find unfortunately lacking. First of all, for the main experimental results in table 1, various existing adaptation methods are presented in table 1 without making clear which backbone and pretraining each method used. This is especially important when we've seen vastly different results even on the proposed method using different backbones. As it is, we cannot be sure if the gains reported in this paper come from the adaptation method or the backbone used. Additionally, for this sort of multi-source adaptation task, only having 3 different domains makes the evaluation kind of weak, especially when you only have 2 source domains in each leave-one-out adaptation split. MGDIL, one of the methods compared against, used 15 different datasets. While those datasets may not all have temporal information, from what I can tell, the proposed method itself does not rely heavily on temporal information and can be adjusted quite easily to work on other social bot datasets while retaining almost all of the novel components. In fact, the ablation section even includes a w/o behavioral channel experiment that runs without temporal information. Also all of the baseline numbers in the comparison are reimplementation of prior methods on this paper's experimental setup without any comparison to their reported numbers, so training and implementation fairness is in question. One piece of evidence that raises the implementation fairness question is that MGDIL (0.394) and BotTrans (0.395) on BotSim24 essentially match the macro-F1 of always predicting “human” (0.395).

Next, the ablation study results does not really support the many of the method components, where often removing one component (such as the routing mechanism, a core contribution), results in no change or even better accuracy and macro-f1 results on two of the three datasets (Fox8 and TwiBot20). This brings into question if the method was over-tuned for a single cross-domain relationship (Fox8 and TwiBot20 to BotSim24). Having additional domain datasets would alleviate this.

Finally, the paper's framing of the method as a style and decision drift decomposition and separate adaptation is not really convincing based on the method description. At the beginning, style is already defined as the residual between the original content feature Z_{R} and style normalized feature Z_G, so style itself is based on the deterministic function G. During training, class-conditional contrastive loss is only applied to this style residual feature between source domains, so it only addresses source domain style drift and not source to target domain style drift. Under the current method, style drift itself also contributes to the bot prediction through g_{sh} shared classification head, so it's not really decoupled from decision drift as stated in the paper.

Questions for authors

See the weaknesses section above.

Reviewer_XvjzOpenReview ↗
Rating
1
Confidence
4
Informativeness
2
Presentation
2
Soundness
1
Read review
Paper summary

The paper studies multi-source unsupervised domain adaptation (UDA) for cross-domain social bot detection. It argues that the source-target discrepancy contains two entangled factors:

representation-level style drift (differences in surface expression such as hashtags, URLs, mentions and emojis) and decision-level decision drift (changes in the mapping from user characteristics to bot labels). The proposed DDDA framework has two components.«

(1) Class-conditional contrastive style alignment. A rule-based rewriting function G(•) removes or normalizes surface markers. A LoRA-adapted RoBERTa encodes both the raw and rewritten posts, and a supervised multi-positive InfoNCE loss is applied to the projected residual z_R - z_G, pulling together same-class samples from different source domains.«

(2) Transferability-guided routing. The model has a semantic channel (a shared head plus sourcespecific heads) and a behavioral channel (emotion/topic statistics and temporal semantic-affinity features). On the unlabeled target, a transferability score for each channel is computed from the global shape of its prediction distribution (GMM-based bimodality, standard deviation, and mean margin).

These scores are mapped to target-level weights over three strategies: direct transfer (rank-averaged semantic and behavioral predictions), behavioral transfer (threshold-shifted behavioral predictions), and semantic adaptation (test-time adaptation of the semantic channel).«

Experiments use leave-one-domain-out transfer over BotSim24 (Reddit, GPT-4o-mini bots), Fox8 (Twitter, suspected ChatGPT bots) and TwiBot20 (Twitter, mixed bots). DDDA reports target Macro- F1 of 0.783 / 0.819 / 0.571, outperforming direct-transfer classifiers, zero-shot LLMs and several adaptation baselines. Ablations and a routing visualization are used to argue that different targets exhibit different drift patterns."

Critical strengths

S1. Relevant motivation and a reasonable direction. The baseline results in Table 1 are indeed strongly target-dependent: methods that work well on Fox8 fail on BotSim24 and vice versa. Treating the choice of transfer strategy as something to be decided per target, rather than fixing one adaptation objective, is a sensible and practically useful direction. Figure 3 gives an interpretable view of how the method handles each target.~

S2. Timely evaluation setting. The evaluation spans two platforms (Reddit and Twitter) and includes LLM-generated bots, which is an important and current setting for bot detection. Full source- and target-domain metrics are reported in the appendix, and an anonymous code repository is provided.+ These strengths are, however, outweighed by the soundness concerns below.«

Critical weaknesses

W1. "Drift" is not defined, and the proposed mechanisms do not demonstrably address it<

This is the central concept of the paper, so its vagueness undermines both the method design and the interpretation of the results.«

• No formal definition. Style drift and decision drift are described only informally. Their relation to standard notions (covariate shift in P(X), concept shift in P(Y X), label shift in P(Y)) is never discussed. "Style" is operationally defined as whatever the hand-written rule G(;) removes, which is circular. No experiment verifies that the two kinds of drift exist or are actually separated; the E-scores in Figure 3 are statistics of the prediction distribution, not measurements of drift.

Label shift is ignored even though the bot ratio differs substantially across datasets (about 35% / 50% / 56%).

• Style alignment never involves the target domain. L style is computed only on labeled sources (positives come from other source domains), so it cannot reduce source-target style drift; the only target-side handling of style is the fixed preprocessing G(;). Moreover, Z style is never fed into any classifier head (the heads use zaG and Zah, Eqs. 3-4), so the claimed benefit of "preserving class-discriminative style information" is not realized in the decision.« • The transferability estimator measures confidence, not correctness. Sep, Var and Mar (Eq.6) depend only on the shape of the prediction distribution. A confidently wrong, or even labelflipped, classifier would receive a high score. This contradicts the claim that the method differs from confidence-based approaches. In particular, Mar = 2|mean(p) - 1/2| is maximized when all target samples are predicted as the same class, so it rewards collapse and is confounded with the target class prior. In addition, the normalization of these statistics to [0, 1] is undefined: each channel yields a single scalar per target. If min-max normalization is performed across the three targets, information from other target domains is used, which would not be available in deployment.-

• Rank-based fusion implicitly assumes a balanced target. The direct-transfer path averages rank-transformed predictions and thresholds the result at 0.5, which forces roughly half of the target samples to be predicted as bots. Fox8, the only balanced target, is also where direct transfer works best. The rank transform is also transductive, which conflicts with the per-sample/per-batch inference in Algorithm 1. Finally, Eq. 9 mixes percentile ranks, shifted-andclipped probabilities and sigmoid probabilities, which are not on a common scale.-

W2. The empirical evidence does not support the main claims«

• The ablation contradicts the routing mechanism. In Table 2, removing routing (using direct transfer only) improves Macro-F1 from 0.819 to 0.850 on Fox8 and from 0.571 to 0.587 on TwiBot20. Removing semantic adaptation also gives 0.850 on Fox8, removing L style givesm 0.844 on Fox8, and removing the semantic channel gives 0.574 on TwiBot20. The router assigns about 55% weight to semantic adaptation on Fox8 and about 98% to behavioral transfer on TwiBot20, yet both choices are worse than plain direct transfer. The advantage of DDDA is therefore essentially limited to BotSim24, where about 96% of the weight goes to semantic adaptation, which follows Song et al. (2025), i.e., the OOD baseline that is already the strongest baseline on BotSim24. It is unclear how much of the gain comes from DDDA's own design. With only three targets and a hand-crafted routing formula (a mid, products of E-scores), the router cannot be meaningfully validated.~

• Missing comparisons with mainstream methods. BotSSCL and BotBuster are cited but not

compared. Established bot detectors (e.g., BotRGCN, RGT, SimpleHGN, BotMoE, LMBot) are absent, and the graph and metadata information in TwiBot20 is unused. Classic UDA baselines (DANN, CDAN, MDD, and M3SDA for the multi-source setting) are also missing. Instead, the comparison includes PoCoMT (object detection), UASA (OOD detection) and SSA (open-set adaptation for vision-language models), which are not designed for this task. Several baselines also appear degenerate: MGDIL obtains 0.338 Macro-F1 on TwiBot20, and on BotSim24 its precision/recall are 0.357/0.499, i.e., near-constant predictions. This raises doubts about how the baselines were reproduced and tuned.«

• Evaluation protocol. The sensitivity analysis (Appendix C.2) reports target-domain metrics and

discusses per-dataset optimal values of ß and a_dir, which suggests that target labels were used for model selection in a UDA setting. The text states that a mid = 0.5 is optimal on all three targets, whereas the implementation uses 0.55. Three seeds are run but no standard deviations are reported. DDDA's target accuracy on BotSim24 (0.788) is higher than its source accuracy (0.746), which is unusual and deserves explanation. The claim of good performance across backbones is contradicted by DDDA (Qwen0.5B) obtaining 0.573 Macro-F1 on BotSim24.~

• The semantic logit l_sem = l_sh + l_spe requires the source index k, which does not exist for target samples. How target inference uses the source-specific heads is not specified.« • The main loss I fuse trains a fused output _fuse, but inference never uses _fuse; the fusion weights n are unconstrained.«

• The estimation of tada and the TTA procedure (updated parameters, loss, steps, learning rate) are not described. If TTA updates the encoder , the behavioral features (which depend on Ф) also change.«

• The behavioral features are inconsistent between the main text and Appendix A (3 + 4 vs. 6 + 10 features). T is not specified; with an average of 18 posts (std 43) on BotSim24, temporal statistics are unstable or undefined for many users. The emotion lexicon and topic model are not specified, and features are not normalized across domains despite very different post counts.- • With batch size 8 and K = 2 sources, many anchors in the multi-positive contrastive loss will have empty positive sets."

• "Routing" produces global target-level weights shared by all samples; the name overstates the mechanism.

Questions for authors
  1. Please give a formal definition of style drift and decision drift, and explain how they relate to

covariate, concept and label shift. Is there any experiment showing that the two drifts exist and are separated by DDDA?<

  1. How exactly are Sep, Var and Mar normalized to [0, 1]? Does the normalization use statistics from other target domains?«
  2. At target inference, which source-specific head is used in l_sem = l_sh + l_spe?‹
  3. How are rank values normalized before thresholding, and how is I ada estimated? What fraction of samples is predicted as bots on each target, compared with the true class prior?+
  4. Were any target labels used for hyperparameter or model selection (including me mid, a_dir and ß)? If not, what validation criterion was used, and why does the sensitivity analysis report target metrics?«
  5. Please specify the TTA procedure. How does DDDA compare with simply applying the TTA of Song et al. (2025) to the same backbone?+

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.