1: Conditional Expert Gain measures the ideal correctness coverage, rather than the classification gain that an actual multi-expert reasoning system can achieve. The connection between the two still requires more direct validation.
This is the issue I believe is most worth discussing in depth in the paper.
Paper definition: $
G(e∣S)=B(S∪{e})−B(S)
$
Among them, �1� represents the proportion of samples for which at least one expert in the expert set made a correct prediction.
This definition is clear and reasonable in mathematical terms.
However, in practical reasoning, the system usually cannot know in advance which expert is correct on the current sample. Therefore, adding new experts increases the theoretical coverage of correct predictions, but it does not mean that the system can directly utilize these additional correct predictions.
For example, a certain auxiliary expert may correctly predict the samples that the existing experts fail on, but if the final fusion strategy cannot identify situations where this auxiliary expert should be trusted, then this complementarity may not necessarily translate into an improvement in the final Top-1 accuracy.
The theoretical analysis of the paper mainly revolves around coverage and residual error recovery, while the final system performance still relies on the expert fusion mechanism of TS-MOF.
Although the experiments indeed show that FSAL improves the final classification accuracy, the paper does not sufficiently establish the following relationship: Increased conditional expert gain → Fusion mechanism effectively utilizes complementary predictions → Improved final classification accuracy.
Therefore, the current conditional gain is more suitable to be interpreted as a potential complementarity indicator, rather than being directly equated to the additional expert gain in actual deployment.
This difference is important because it directly affects the practical significance of the core analytical metrics of the paper.
2: FSAL combines various existing frequency-aware techniques under a unified correspondence, but current experiments are not sufficient to fully prove that the "shared correspondence" is the key source of performance improvement.
FSAL uses multiple frequency-related mechanisms:
- Category-related temperature adjustment.
- Logit adjustment related to prior probabilities.
- Margin related to category frequency.
- Delayed sample reweighting.
The basic ideas of these techniques have been extensively studied in long-tail recognition.
The core methodological innovation of the paper is to unify category frequency mapping, allowing these mechanisms to share a consistent category direction.
This design has a certain degree of rationality, but it is necessary to further distinguish between two different sources of improvement: The first is the performance gains brought by combining multiple existing long-tail learning techniques.
The second is the additional benefits brought by using a unified category frequency correspondence for these techniques.
The current experiment demonstrates the variations in category correspondence under normal, random, and reverse settings, and a related target analysis is also provided in the appendix. But merely proving that the frequency correspondence of errors reduces performance does not sufficiently demonstrate that the unified correspondence combination method is superior to the reasonably configured conventional frequency-aware targets.
Especially since the method in the paper inherits the two-stage framework of TS-MOF, it is necessary to more directly compare versions that use the same components but do not adopt the FSAL unified design.
If this factor cannot be clearly isolated, the contribution of the FSAL method may be more akin to an effective integration of existing frequency-aware objectives rather than a new auxiliary expert learning mechanism.
Dear Program Chairs, Senior Area Chairs, Area Chairs, and Reviewers,
We sincerely thank all reviewers for their thoughtful evaluations and constructive discussions. We are particularly encouraged by their recognition of the significance of our study of auxiliary-expert complementarity, the accuracy–gain inversion, and the role of class-frequency correspondence in long-tailed recognition.
Our work makes three connected contributions:
The discussion has further strengthened the empirical support and presentation of these contributions. Our additional analyses clarify the relationship between CEG and realized ensemble gains, distinguish objective formulation from correspondence coordination, and provide further evidence on component contributions. In the revised manuscript, we will make these distinctions clearer and include the requested qualitative visualizations of recovered samples.
We are grateful for the reviewers' and ACs' time, expertise, and thoughtful engagement. Their feedback has helped us better communicate the significance of the problem, the insight revealed by our analysis, and the contribution of FSAL.
Sincerely,
The Authors