- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper introduces behavior gradient fileds, that links have a behavior objective propagates through the training data space and model weight space (Figure 1). Based on the set of inducing datasets, the authors propose data streeing maps, which are algorithms that are used to discover diverse inducing datasets. These data steering maps are used to find paths between different datasets and (possibly) avoid unwanted behavior such as spurious correlations.
Critical strengths
- The motivation is clearly stated and supported throughout the manuscript, and the data level view of multiplicity is a novel perspective. Figures 1, 3, and 5 are well constructed and directly support the paper’s narrative. The two proposed methods MG-DSM and A-DSM are built on two recent important works: metagradient descent (Engstrom et al. 2025) and probe-based activation (Xiao et al. 2026). Hence, the cover two distinct data steering options.
Critical weaknesses
- The only critical weaknesses that I see is the lack of baselines to compare against. E.g., in the vision experiments including spurious correlations, MG-DSM is only compared against the linear mixing between two datasets. While this helps in illustrating the dormant spurious correlation mechanism, it is a weak baselines for judging MG-DSM's performance. One can provide simple stronger baselines than convex linear mixing, such as mixing schedules beyond the straight line given between A and B, or a non-convex mixing ratio tuned on the same validation set as MG-DSM. Furthermore, the LLM experiments only compare the proposed MG-DSM and A-DSM against each other, providing simple baselines could help show how much the steering signal itself contributes.
Questions for authors
- From my understanding, the paper presenets two data steering maps, MG-DSM (Algorithm 1) and A-DSM (Algorithm 2) as different ways to implement the proposed framework, where the first is based on the metagradient and the second on the activation. However, their roles in the paper seem unclear to me, as MG-DSM outperforms A-DSM in nearly every setting. A-DSM seems to serve two purposes, as a baseline comparison against MG-DSM that supports the claim of metagradient based data steering being more successful than activation based data steering. Furthermore, it might also be used to support the multiplicity argument that multiple/different steering paths may lead to same behavior through different data. Could the authors clarify what role does A-DSM specifically play in the paper? If it is provided specifically as a baseline, I suggest framing it as such other than a second proposed algorithm. If not, I suggest explaining in what scenario someone would prefer A-DSM over MG-DSM.
- To support the comparison between A-DSM and MG-DSM, I suggest reporting the computational cost of A-DSM and MG-DSM.
2 comments
Image/Tabular Setting: For Section 4.1., our focus is on finding a path connecting two datasets while avoiding undesirable intermediate behavior, such as reliance on spurious correlations. Any continuous scalar mixing schedule connecting A to B must pass through every intermediate mixing ratio, including those corresponding to undesirable behavior.
Selecting a mixing ratio using validation loss addresses a related but different objective of finding a single high-performing mixture (rather than a path connecting A to B). We evaluate this baseline using the same validation objective as MG-DSM; note that validation loss can be nonconvex with respect to the mixing coefficient. In both settings, selection favors mixtures near an endpoint. This is consistent with the observed drop in performance of intermediate mixtures along the original mixing path. For our SpuCoBirds setting, it selects 99.5% A / 0.5% B across all five seeds. For tabular, every selected mixture assigns at least 92.5% weight to one source.
To similar effect, we also test a nonlinear sampling schedule (), using the same number of sampled points and identical endpoints, and compare our path-length ratio (), which measures how far the prediction trajectory deviates from the straight path between its endpoints.
| Setting | Original (): detour (): ↓ | (): detour () ↓ |
|---|---|---|
| Class frequency dormancy (SpuCoBirds, ResNet-9) | 5.54 ± 0.19 | 5.38 ± 0.21 |
| Measurement noise dormancy (tabular, MLP) | 1.81 ± 0.04 | 1.81 ± 0.04 |
Table: Prediction space detour under two sampling schedules for mixing path, for spurious correlations arising from measurement noise or class frequency differences. Mean ± SD across five seeds.
Along with this table, we have added accuracy graphs in Appendix A.3.1, which show that changing the schedule merely shifts the accuracy dip along the schedule parameter without removing it; in SpuCoBirds, the lowest mean accuracy is 53% under both schedules, but occurs at for the original schedule and under the squared.
Constructing a different path requires changing the relative weights of examples within each source, beyond adjusting the overall A/B ratio. Compton et al. [3], whose work inspired our class-frequency setting, propose source-label balancing, i.e., matching class proportions across sources, whether 50/50 or another shared ratio. By construction, this negates spurious associations induced by class frequency differences.
However, in our tabular setting, sources are already class-balanced, so this intervention is equivalent to linear mixing and therefore cannot mitigate spurious associations. We emphasize that part of our contribution is demonstrating that measurement noise can activate spurious correlations along a mixing path (despite matched class proportions across sources), which to our knowledge, has not been shown prior. This motivates methods such as MG-DSM, which uses gradients of the behavioral objective through training to determine how to reweight examples. We have clarified the above points in Appendix A.3.1.
[3] Compton et al. When More is Less: Incorporating Additional Datasets Can Hurt Performance By Introducing Spurious Correlations. Machine Learning for Healthcare, 2023.
We appreciate the reviewer’s thoughtful feedback and recognition of data-level multiplicity as a “novel perspective.” In response, we have added baseline and computational cost comparisons, as well as clarified the role of A-DSM below.
Q1 (Role of A-DSM): The role of A-DSM is to show that the attribution scoring rule and its underlying assumptions can lead to consequentially different steering paths. A-DSM (activation- based) and MG-DSM (gradient-based) exemplify this difference: (1) for refusal, A-DSM strongly weights safety sources, while MG-DSM finds strong signal in scientific reasoning datasets and identifies more concentrated paths; (2) for sycophancy, A-DSM’s limited gains shows that an effective inference-time steering vector does not necessarily provide an effective data-steering signal. We note that attribution scoring rule is one axis of data multiplicity, and others like joint objectives and the training map are also consequential.
There is also a practical advantage to A-DSM, as activation-based scoring is significantly cheaper than differentiating through training, which we address below. It is therefore both a practical steering method and a contrasting approach for studying multiplicity rather than solely a baseline for MG-DSM.
Language Model Setting. To help practitioners assess these tradeoffs, we have added computational cost comparisons in Figure 6(c), alongside four additional gradient-based baselines. As with MG-DSM, these methods use gradient information to estimate how training examples affect the behavior proxy, but differ in how they account for the training trajectory, optimizer state, curvature, and gradient magnitude. We also compare the iterative reweighting procedure used here with simpler data filtering across all methods, with details in Appendix A.1.2.
Our new Section 4.3 (“Generality of Data Steering Maps”) additionally extends the evaluation to Llama-8B. Below, we report Llama-8B sycophancy performance and attribution costs; the other settings are shown in Figure 6.
Table: Llama-8B sycophancy reduction after three rounds, averaged over four seeds, versus attribution cost (Figure 6). The corresponding refusal comparison, where A-DSM is more effective, is shown in Figure 9.
We find that MG-DSM achieves a larger sycophancy reduction at similar computational cost to influence functions (EK-FAC) and TracIn. Across the four model-behavior settings, it achieves the highest final-round mean in three of four. For other methods, we interestingly find performance can vary across settings: TrackStar achieves a 38.7 pp refusal increase on Llama, but reduces sycophancy by only 1.1 pp on Gemma and 1.7 pp on Llama; two hypotheses here are that preserving gradient magnitude or incorporating earlier checkpoints helps capture sycophancy steering signals. We believe that further understanding how these underlying assumptions affect steering signal is an interesting direction for future work.
Prior work [1, 2], which has focused on activation and likelihood-based attribution for post-training behaviors, has shown limited success with steering sycophancy. Our results show that gradient-based methods, particularly MG-DSM, can be more effective in this setting, while refusal responds to a broader range of methods. We have added clarifications in Sections 3 and 4.3 to address both Q1 and W1.
[1] Blank et al. Sycophantic Agreement Transfers with Neutral Data via Contrastive Preference Optimization. arXiv, 2026.
[2] Bergen et al. Anatomy of Post-Training: Using Interpretability to Characterize Data and Shape the Learning Signal. arXiv, 2026.