- Rating
- 2
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies whether hidden actors can be recovered from anonymized event streams using behavioral information. Prior work usually relies on known actor identities or simulated data, which makes it difficult to evaluate recovery on real anonymized streams. The authors identify a special real-world setting in historical cryptocurrency trading data where a large number of events can be associated with actor labels, making large-scale analysis possible.
Based on this dataset, the paper systematically studies latent-source recovery and finds that incorrect segmentation is consistently worse than using no segmentation, while correct segmentation provides only a small and unstable improvement. The authors conclude that behavioral information does contain recoverable actor-specific signals, but practical recovery remains difficult because the main bottleneck is not simply representation learning, but correctly identifying event boundaries and grouping events from the same source.
Critical strengths
-
The paper presents an interesting and practical idea for studying latent-source recovery in real-world data. Leveraging structured client identifiers in historical cryptocurrency trading data to obtain actor labels is both intuitive and reasonable, and allows the authors to analyze the problem at a relatively large scale.
-
The experimental design is comprehensive and rigorous. The paper evaluates the problem from multiple perspectives, including segmentation, temporal and cross-asset transfer, learned representations, actor-count estimation, and simple defenses, while also using controlled comparisons to isolate the effect of key factors.
Critical weaknesses
-
The overall contribution and significance of the paper are somewhat unclear to me. Although the paper provides a careful measurement study, the main findings are relatively limited: incorrect segmentation performs worse than no segmentation, while correct segmentation only gives a small and unstable improvement. These results help characterize the problem, but they do not seem to lead to a particularly strong or surprising conclusion, nor do they provide a concrete solution to the main challenge of latent-source recovery.
-
The generalization of the findings is limited, since the experiments only cover identifier-leaking clients. It is unclear whether the same conclusions hold for other anonymized event streams.
Questions for authors
Could the authors clarify what broader lessons or research directions they expect this work to bring to the field? In particular, beyond showing that incorrect segmentation can be harmful, it would be helpful to explain how these findings may change the way future latent-source recovery methods or evaluation protocols are designed.
2 comments
Thank you for the clarification. I appreciate the additional discussion and experiments, which make the paper's contributions and limitations clearer. However, I still think that the overall contribution falls below the acceptance threshold for ICLR. Therefore, I will maintain my original score.
Thank you for the review and for a summary that states the findings accurately. One nuance shapes our answer: the paper reads boundaries as "a fragility, not a constraint". Correct boundaries buy little over not blocking at all, while corrupted ones cost a great deal.
[1] Significance and broader lessons
We agree the paper offers no new method. Its contribution is to change how methods are evaluated. Each practice below follows from a result in the paper, and the revised PDF states them in a new paragraph in Sec. 6 (p. 10):
[2] Generalization beyond identifier-leaking clients
We agree, and the paper states this limit as a measured scope. A classifier given only behavioral features predicts whether an order is labelled at 0.8790 mean AUROC over 17 sessions (label-shuffle controls 0.48–0.52). Under a rule fixed before the diagnostic ran, a high value restricts every claim to identifier-leaking clients, so the title and every recovery claim carry that scope.
Within that population the signal is more than identifier-family classification: with family held constant, actors still separate at six to seven times chance in the largest family. Recoverability for clients with sound identifier hygiene is not measurable with this instrument, in either direction, and the simulator experiment (Appendix Z) tests the protocol's logic, not that question. A wider claim would exceed the evidence. What transfers is the protocol, which applies to any stream in which a source label can be read but withheld.