- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
In the proposed approach, the authors introduce an adaptation of the contextual representations in order to support the prediction of unlabeled queries. For that, the authors introduce an in-situ representation refinement step, in which supporting labels provide information for modification of hidden representations within a single forward pass, and without updating the pretrained model parameters.
The manuscript formulates a leave-one-out objective to learn representations of supporting samples, i.e., each support sample is predicted from other supporting samples. The modified representation can then be used also for unlabeled queries via a kernel-based formulation.
Next, the authors propose separating two branches, a attention-like weighted aggregation of supporting samples and a scaling factor.
Critical strengths
S1: Adaptive representation refinement
The idea of questioning the representations of support examples is in itself interesting, rather than solely relying on the implicit predictive performance of the model.
Critical weaknesses
W1: Missing theoretical justification
If the argument from the proposed pipeline is that updating a training sample’s representation during a forward pass can give a lift for later predictions, then I’d assume that the same thing also happens in standard transformer. A conventional architecture also updates its internal representation at every layer. With the intervention in the mid-stack, it seems that the experiments show evidence that these representation transformation matter, but why is it considered that this is unique for the proposed approach? Maybe a clearer distinction between the benefits of the gate would shine some light on this claim, but currently I do not see the fundamental difference.
W2: Missing ablation on the block selection
The next thing, I’m wondering is the assumption of the mid-stack intervention. In related work like in exit networks, we see investigations where the major changes happen in the first and the last few layers depending also on the downstream task. So what was the reason behind the design choice to pick a mid-stack intervention. I’m missing a thorough ablation on this point. And also why just a single intervention and not k-many of them?
W3: Flaws in the AI-generated text
we also see flaws in the presentation of the paper. In equation 2 there is a rendering error or a missing package. The text in the figures (e.g., Fig2) are not properly aligned and overlap sometimes with other elements, i.e., seems highly llm generated. Equation 11 is a rendering error again etc. .
The conclusion is also just a paragraph instead of a separate section. No limitations are discussed.
W4: Recommended statements are missing
According to the guidelines, it is also recommended to put a ethics statement and a reproducibility statement in the text, both are missing.
W5: Figure 4 and its experimental setup
“We permute the attention output, gate, or their paired update across queries before residual addition.” The authors discuss now that those permutations reduce the overall accuracy. However, isnt this behavior also expected in any neural architectures that are fed with some contextual information, i.e., where each token receives a state-dependent information. So the experiment shows that updates are well-aligned with some query representations. But what the experiment does not show is what the claim of the paper is, i.e., it does not evaluate the proposed representation refinement heuristic from just some ordinary processing. So, what is the difference for example to some conventional attention-based architectures or why is it assumed that the refinement mechanism outperforms any other contextual processing?
W6: Component analysis
So, at the end of the day, it is not clear from the experimental setup which components now account for the improved performance w.r.t. established TFMs. Maybe the authors can work on this analysis in a major revision of the manuscript. Appdx F.3 suggest that the contextual gate has stronger impact than individual feature-interaction. But does this component better performance than other design choices under comparable conditions… that is not clear to me.
Questions for authors
-
Q1: Can the authors provide a discussion on the justification of the proposed approach and how it fundamentally delineates from conventional modification we see in ordinary transformer architectures? (W1)
-
Q2: Did the authors conduct experiment on the placement of the proposed intervention? In the manuscript the authors chose for a mid-stack intervention, but did the authors conduct an ablation on this? (W2)
-
Q3: Can the authors provide a better understanding of the benefit of the proposed approach compared to conventional attention-based architectures? (W5)
-
Q4: Did the authors conduct a more thorough analysis of the contributions of each of the models’ components to investigate which part actually could provide a lift? (W6)