1. Limited benchmark coverage and insufficient evidence of generalizability
The central motivation of E2T2S is that scholarly literature contains reusable tacit expert procedures that can improve specialized multimodal reasoning. This suggests a potentially general framework for transforming accumulated expert knowledge into transferable reasoning skills. However, the proposed framework is evaluated exclusively on Chinese Chu bamboo-slip character interpretation, formulated as a four-choice classification task. While this is a relevant and challenging application, I do not find it sufficient to establish the broader effectiveness of the proposed framework.
In particular, it remains unclear whether E2T2S learns generally useful procedures for evidence-based expert reasoning or primarily captures domain-specific heuristics that are particularly effective for ancient Chinese character interpretation. For example, several procedures illustrated in the paper, such as contextual semantic constraints, candidate elimination, and comparison against parallel texts, are closely aligned with the requirements of the evaluation task. Consequently, the reported improvements could potentially arise from task-specific procedural guidance rather than a broadly applicable mechanism for recovering tacit expert knowledge.
I believe evaluation on at least one additional task or domain would substantially strengthen the paper. Ideally, this would involve another specialized reasoning task requiring the integration of heterogeneous evidence from scholarly literature. An additional evaluation setting within ancient-text interpretation, using a different dataset or an open-ended interpretation task, would also provide useful evidence of robustness.
I recognize that a single-domain evaluation is not inherently insufficient for a research contribution. However, given the generality of the proposed E2T2S framework and its motivation, the current evidence supports a substantially narrower conclusion than the paper appears to suggest. Without further evaluation, the authors should more carefully scope their claims to the investigated paleographic task.
2. The core tacit knowledge extraction mechanism is insufficiently specified and validated
Section 3.2 defines scholar-level tacit knowledge as a combination of core stance vectors, decision templates, boundary and exception rules, and revision traces. However, the paper does not provide sufficient implementation details for the main extraction and construction procedures. In particular, several important questions remain unanswered:
- How does the framework identify recurring decision patterns across a scholar's publications?
- How are genuine methodological regularities distinguished from paper-specific observations?
- How are revision traces identified and validated across different publications?
- How are canonical skill patterns defined and aligned across scholars?
- How is the evidence-state matching score computed for dynamic skill selection?
The corresponding functions, including the tacit extraction function, skill alignment function, and evidence-state construction function, are presented primarily as abstract mappings.
More importantly, the paper does not directly validate whether the extracted procedures faithfully represent the scholarly reasoning patterns from which they are supposedly derived. This is a critical issue because the main novelty is not simply the use of procedural instructions or dynamically selected skills. Prior work has already explored procedural knowledge, expert decision models, structured reasoning, and reusable skill libraries, including PlaSma (Brahman et al., 2024), Bridge (Wang et al., 2024), Voyager (Wang et al., 2023), and SkillWeaver (Zheng et al., 2025).
The distinctive contribution of E2T2S should therefore lie in systematically recovering reusable expert procedures from scholars' research trajectories. However, the paper does not convincingly distinguish this process from generating plausible domain-specific reasoning instructions based on scholarly texts.
I would encourage the authors to provide complete, provenance-traceable examples showing how multiple papers by the same scholar are transformed into explicit knowledge representations, recurring decision patterns, and final skills. An evaluation by domain experts of the fidelity and applicability of these extracted procedures would also strengthen the technical contribution.
3. The ablation study does not adequately isolate the contribution of each stage
Although the paper includes stage-wise ablations, their design makes the results difficult to interpret causally.
In Table 3, removing tacit knowledge extraction reduces accuracy from 51.57% to 27.11%, substantially below the Base accuracy of 38.74%.
However, according to Section 4.6, the w/o Tacit variant directly uses structured explicit knowledge for retrieval-based augmentation. This changes the representation and use of information provided to the model, rather than simply removing tacit procedural knowledge while keeping the remaining inference procedure unchanged. Consequently, the observed performance degradation could arise from ineffective knowledge presentation, irrelevant additional information, or other differences in the resulting prompts. It does not necessarily quantify the isolated contribution of tacit knowledge extraction.
Similarly, the w/o Explicit variant directly extracts tacit knowledge from scholarly papers and uses it as static procedural guidance. Since this ablation changes both the extraction pathway and the form of procedural guidance, it is difficult to attribute the performance decrease exclusively to explicit knowledge extraction.
I believe the authors should include more controlled ablations that preserve the same inference pipeline while modifying only the source or selection of skills. In particular, comparing single-paper versus scholar-level skill extraction and static versus dynamic skill selection would provide substantially stronger evidence for the proposed framework's key design choices.