Figure presentation needs improvement. E.g. raw expressions left in the figures make it look like no human review of this paper before submission.
More models should be tested to show efficacy of the method proposed.
The principal SAE-versus-raw comparison confounds the SAE with coordinate selection and a different leakage penalty. The raw baseline anchors arbitrary residual dimensions 0–2, whereas the SAE baseline selects latents already correlated with RGB on a calibration split (pre-anchoring selected-latent probe R² 0.2673 versus 0.0022 for three random latents; Table 1). As the authors note on p. 6, a raw baseline anchored along probe-aligned directions is missing. Equation 2 also penalizes 893 unanchored raw residual dimensions in the raw arm but 7,165 unanchored ReLU SAE latents in the SAE arm. The same nominal penalty weight therefore imposes different constraints; the raw penalty's pressure on almost the entire residual vector could itself contribute to the larger language-modeling cost. Table 2 reads the base and raw-anchored models from arbitrary raw coordinates, but Phase 4 from already color-correlated SAE latents; a same-latent, unanchored readout control is missing. The 0.17 percentage-point in-domain accuracy advantage and MAE improvement do not isolate an SAE-specific benefit. Only one training seed is tested (p. 6), and the accuracy tax is measured only on held-out CSS windows.
The generation experiments do not establish that anchoring enables selective control. The intervention adds frozen SAE-decoder directions to the residual stream; it is tested on the anchored Phase 4 model without a corresponding steering test on the unadapted or raw-anchored model. At the largest green steering scale, green increases by 0.303 while off-target blue increases by 0.361 and red by 0.243 (Fig. 3/Table 3), even though the intervention assigns negative coefficients to the off-target latents. The blue increase exceeds the target increase; the paper also reports a red-clamped output with R = 0.021 rather than a saturated red (p. 6). The reported steering means across ten color prompts have no per-prompt spread or uncertainty. The ten-prompt general-code check assesses syntax and color intrusion, but lacks a correctness metric; its intervention fires once at the final prompt token rather than at a color-literal position (p. 7). One displayed quicksort completion changes the base case from length ≤1 to ≤2, which would return an unsorted two-element input (Table 6, p. 13). The CAA baseline's actual injected residual norms and scale tuning are not reported. Table 4 tests red-channel readout across formats without unadapted or raw-anchored controls, so it does not attribute that transfer to anchoring. These limits matter because steering is a central claimed payoff of creating the anchor.