- Rating
- 4(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper addresses node classification on long-tailed text-attributed graphs, where tail classes lack sufficient semantic and structural evidence. BEAST uses LLM-generated auxiliary subclasses to guide semantic augmentation, filters synthetic nodes near class prototype boundaries, and learns their connections through a class-rebalanced shadow model. Hierarchical supervision links the auxiliary subclasses to the original labels, aiming to expand tail-class coverage beyond the observed samples. Experiments on various benchmark report higher accuracy than the evaluated baselines and improvements in most class-balanced metrics.
Critical strengths
S1:The method addresses both the semantic content of synthetic nodes and their graph connections, providing a coordinated approach to tail-class augmentation.
S2:The hierarchical supervision design is well motivated, as it incorporates fine-grained subclass semantics while maintaining consistency with the original classification task.
Critical weaknesses
W1:The ablations do not directly isolate the benefit of boundary-oriented sampling. A comparison with random or non-boundary sampling under the same setting would establish its contribution.
W2:The paper does not report accuracy separately for head and tail classes, making it unclear whether the improvements stem from head classes, tail classes, or both. It’s recommended to report subgroup accuracy and comparing them with the main baselines to verify its effectiveness in improving performance for tail classes.
Questions for authors
Q1:How does boundary-oriented sampling compare with random and non-boundary sampling when the number of accepted synthetic nodes is held fixed?
Q2:What are the separate head and tail-class accuracy, does the improvement stem from head or tail?
Q3:How does performance vary with the number of auxiliary subclasses per tail class?
Q4:While keeping the synthetic nodes and their semantic content unchanged, how much additional benefit does the proposed connection method provide compared to simple strategies?
Q5:Since BEAST utilize a LLM to generate auxiliary nodes, how much additional computational overhead does the BEAST enhancement process introduce?
5 comments
Response 2
Q3: How does performance vary with the number of auxiliary subclasses per tail class?
R3: Thank you for your comment. We investigate the effect of the number of auxiliary subclasses on the Photo dataset using five random seeds. We choose Photo because it provides a complementary evaluation on an Amazon co-purchase graph and contains 12 categories, including 8 tail classes, offering a suitable setting to examine the impact of auxiliary subclass granularity. As shown in the Table, increasing the number of requested subclasses does not lead to monotonically improved performance. Using four subclasses achieves the highest accuracy of 65.60% and a Macro-F1 of 63.98%. Increasing the number to eight brings negligible improvement in Macro-F1 while slightly reducing accuracy. These results suggest that four auxiliary subclasses offer a favorable balance between semantic diversity and generation effectiveness.
| Auxiliary Subclass | Accepted nodes | Added undirected edges | Acc (%) | Macro-F1 (%) |
|---|---|---|---|---|
| 1 | 85 | 3,400 | 64.78 | 62.97 |
| 2 | 92 | 3,680 | 63.89 | 63.41 |
| 4 | 77 | 3,080 | 65.60 | 63.98 |
| 8 | 63 | 2,520 | 64.81 | 63.99 |
Q4: While keeping the synthetic nodes and their semantic content unchanged, how much additional benefit does the proposed connection method provide compared to simple strategies?
R4: Thank you for your comment. To isolate the contribution of the proposed connection method, we keep the synthetic nodes and their semantic content unchanged while varying the connection strategies. As shown in the Table, our recovery method consistently achieves the highest Macro-F1 across all three datasets, outperforming the strongest alternative by 0.48, 0.67, and 1.50 percentage points on Cora, PubMed, and Citeseer, respectively. It also consistently outperforms the no-edge setting, demonstrating that appropriately recovering connections provides additional benefits beyond semantic augmentation alone. These results validate the effectiveness of the proposed topology recovery strategy.
| Method | Cora | PubMed | Citeseer |
|---|---|---|---|
| Semantic kNN | 73.82 | 71.50 | 63.60 |
| Random | 69.00 | 70.66 | 61.96 |
| VGAE | 70.71 | 71.42 | 63.02 |
| No edges | 73.25 | 70.86 | 63.24 |
| BEAST | 74.30 | 72.17 | 65.10 |
Q5: Since BEAST utilize a LLM to generate auxiliary nodes, how much additional computational overhead does the BEAST enhancement process introduce?
R4: Thank you for your comment. To quantify the additional LLM-related computational overhead, we compare the invocation counts and token consumption of BEAST and SAVE-TAG-S. As shown in the Table, BEAST requires more LLM calls across all three datasets, with increases of 60.0%, 87.5%, and 31.3% on Cora, PubMed, and Citeseer, respectively. Although BEAST requires more LLM calls and incurs comparable token consumption, it achieves better classification performance, demonstrating the effectiveness of its more comprehensive semantic augmentation.
| Dataset | BEAST LLM calls | BEAST input / output tokens | SAVE LLM calls | SAVE input / output tokens |
|---|---|---|---|---|
| Cora | 32 | 39,664 / 19,897 | 20 | 36,331 / 16,711 |
| PubMed | 15 | 27,639 / 10,355 | 8 | 29,041 / 9,541 |
| Citeseer | 21 | 43,129 / 23,838 | 16 | 33,476 / 17,300 |
Thanks again for appreciating our work and for your constructive suggestions. Please let us know if you have further questions.
Thank you for the informative rebuttal. My concerns have been adequately addressed, and I have therefore raised my score from 3 to 4.
Response 1
We are truly grateful for the time you have taken to review our paper, your insightful comments and support. Your positive feedback is incredibly encouraging for us! In the following response, we would like to address your major concern and provide additional clarification.
W1&Q1 Boundary Sampling at a Fixed Augmentation Budget
R1: Thank you for your comment. We conduct a controlled comparison among random, interior, and boundary-oriented sampling while keeping the number of accepted synthetic nodes fixed. As shown in the Table, BEAST consistently outperforms both alternatives across all five metrics. In particular, compared with random sampling, BEAST improves Macro-F1, balanced accuracy, and tail macro recall by 1.08, 1.32, and 1.33 percentage points, respectively. These results demonstrate that boundary-oriented sampling provides additional benefits beyond simply increasing the number of synthetic nodes, particularly in improving balanced and tail-class recognition.
R2: Thank you for your comment. We thank the reviewer for this valuable suggestion. We report head- and tail-class accuracy separately to identify the sources of performance improvements. As shown in Table, BEAST consistently improves head-class accuracy across all three datasets. More importantly, it substantially improves tail-class accuracy on PubMed and Citeseer by 4.62 and 8.07 percentage points, respectively, despite a slight decrease on Cora. These results demonstrate that BEAST not only enhances head-class recognition but also provides substantial benefits for tail-class recognition.