- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
semi-NMF on features + frozen linear head -> exact closed form attribution/ablation on recon logits.idea is neat, table3 fidelity ok on archived bundles.but results not really reproducible and baselines arent fully controlled. weak reject for now
Critical strengths
attribution = signed logit drop when ablating (also zero baseline IG),so its tied to the reconstructed forward pass not just picked patches. nice
tab 3: nonneg coords keep top1 almost same acc, no retrain. seems usable
Critical weaknesses
code doesnt match paper
main.py hardcodes n_components=200 but sec 5.3 says k=600/700/900 for main table. so the released driver doesnt even run the reported config
eq 9 uses mean of max(α,0) but insert_deletion.py line33 just averages raw signed vals?? in principle → ranking may flip, so ins/del curves may change
experiment.py ranks + evaluates on same test split. not held-out
tab2 solver not said, tab3 from a separate archive. incomplete run-linked code/logs so cant check the main numbers
baselines
attribution identity is kinda free once u have linear decoder+affine head,so everything rides on beating simpler methods. tab2 mixes diff heads/dims/budgets.. app K has PCA,TopK-SAE but no same-protocol FLACE row. so does it beat plain PCA? not clear
Questions for authors
tab2 made w/ eq9 or the unclamped mean in repo? holds on seperate calib split?
one clean rerun for tab2 (solver cfg,recon fidelity,logit residuals)?
FLACE vs PCA vs topk-SAE in app K setup, same feats/head/budget?