- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This work is about Functional Network Fingerprint (FNF). It is a training-free, white-box test of if a suspect LLM was derived from a victim LLM. Nothing is matched between the two models, so the method is supposed to work when depth, width or tokenizer differ. The authors propose CanICA, which extracts spatial maps and with a threshold, each map is filtered to form core neurons. The idea seems inspired from the causality perspective as well, since they try to find neurons that are causally responsible for certain task in the architecture. The authors frame the work as a “weight repackaging” attack, for example SOLAR-10.7B built from Mistral-7B by depth up-scaling.
Critical strengths
-
The method is simple, needs no correspondence between models.
-
Paper is clearly written and easy to follow
-
I think the idea is novel, and the inspiration from neuroscience makes sense and also the proposal of CanICA and its corresponding formulation is correct.
-
The experimental setup looks correct with no concerns around the evaluation scheme.
Critical weaknesses
-
The main claim of the paper is not sufficiently tested. The paper presents "weight repackaging" as changing depth, width and tokenizer, but all three repackaged pairs (Mistral-7B, SOLAR-10.7B, Mistral-11B) change depth only and use the same tokenizer. No derived model with expanded width, interpolated layers or a new tokenizer is evaluated.
-
I feel the whole work is a bit empirical and done under specific setting. I worry if the idea is generalizable, and whether we could have similar analysis on bigger, more complex models.
-
To justify that the FNF is not tuned to their own evaluation scenario and benchmark, is there any other setting where FNF can be evaluate for example LeaFBench?
-
I believe that the robustness is evaluated against the transformations that the FNF is invariant to by design. FNF is not affected by permutation and scaling by construction. What if there is a function-preserving orthogonal rotation that keeps outputs identical and likely breaks the neuron-aligned structure that spatial ICA relies on, while CKA-based REEF is unaffected by it. No such scenario is evaluated and I wonder if it would generalize
Questions for authors
I have asked my questions and raised my concerns as part of the weakness section.
Suggestion: Although the score is not affect by this, but I would recommend authors to make the plots better, if it is accepted eventually. The plot labels and legends are a bit hard to read. Also, even though authors acknowledged the use of AI for paper drafting it would be better if they could remove some of the many "--" double dashes from the paper, if it is avoidable.
First of all, sorry for the late reply and thanks for your patience.
I appreciate the efforts of the authors and the justification provided during the rebuttal. Honestly, I am still not totally convinced about certain aspects of the work, especially regarding the scalability and practicality. Most of the work is done on small model setup.
That being said, I am taking nothing away from the methodology proposed and efforts taken by the authors to justify their research. I also understand the resource and other practical constraints.
The only reason I would think about increasing the scores is because of the efforts, which I feel is not fair, since I would have to take the decision based on the soundness of the work. Hence, I would like to maintain my rating.