- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes Provenance Networks, which augment a standard model with an index branch for retrieving specific training examples as exemplars at test time. The authors consider single-branch and two-branch variants. Their evaluation tests whether memorized training indices can be recovered from perturbed inputs, with augmentation-invariant training substantially improving source recovery. Comparisons are provided against embedding-based kNN and prototype-based methods. Scalability is further examined through exemplar subset selection and factorized index heads.
Critical strengths
-
The paper presents a simple and intuitive architecture that directly links model predictions to retrievable training exemplars.
-
The paper is generally clearly written and includes a broad empirical evaluation across multiple datasets and settings.
Critical weaknesses
-
It is unclear why retrieving every individual training sample is more useful for explanation than using representative prototypes, especially given prototype-based methods with tree-structured designs that can already provide fine-grained explanations. This finer granularity of this work comes with substantially worse scalability and performance. Moreover, although every training instance is theoretically retrievable, the paper does not show that test-time explanations actually make use of this broad coverage. No retrieval-coverage or diversity analysis is provided.
-
The task and index branches are jointly trained, but the paper does not show that the task prediction is strictly based on the retrieved sample. The only support is empirical retrieval performance rather than a theoretical or causal guarantee.
-
Treating every training sample as a separate prediction target is also questionable from a learning perspective. Modern models are expected to learn patterns that generalize beyond discrete training instances, while the proposed index objective explicitly encourages instance-level memorization. The paper does not convincingly show that this formulation can preserve generalization on more complex tasks.
Questions for authors
-
What evidence shows that the retrieved training sample actually explains the task prediction, rather than simply being correlated with it through the shared representation?
-
Why is it necessary to make every training sample individually retrievable, especially when the paper does not show that such broad coverage is used in practice?