- Rating
- 2(−1)
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper critizes that current Deep Imbalanced Regression (DIR) methods enforce representation constraints at the one fixed model depth. The authors propose "Depth-aware Manifold-Gated Mixture-of-Experts (DMG-MoE)", which attaches a lighweight depth-wise expert to different stages of depth, the idea is that the deeper the layer the more it improves the performance for medium- and few-shot cases. The final prediction is the weighted sum of all experts done with a stick-breaking routing. Their key signal is Depth-wise Manifold Alignment (DMA). During training a DMA teacher compares the label and feature neighborhood via KL-divergence and by that quantifies the alignment with more depth. For inference this is distilled into a label-free gate.
Critical strengths
- Novel idea, very informative and nicely written/structured paper. Moving from “one depth fits all” to sample-specific depth allocation guided by a geometric signal is a new angle for DIR. The method is clearly motivated (Fig. 2) and cleanly explained.
- Extensive ablation studies and deep analysis of the isolated components. Also tested on different model types and sizes.
Critical weaknesses
- No comparison with UVOTE (strong recent DIR method). UVOTE (Jiang et al. 2025) reports for all/many/medium/few in their own paper 6.82/6.55/7.37/7.80 and Puetz et al. (2026) comfirmed in their experiments across 10 seeds similar results with 6.77 ± 0.08/6.38 ± 0.12/7.32 ± 0.28/8.91 ± 0.37. Beating DMG-MoE on all, medium and few-shot in both cases. Also experiments on AgeDB-DIR and IMDB-WIKI-DIR seem to be single runs, so its hard to distinguish significant results when the difference is sometimes small between two values.
- The method uses Focal-R as the regression loss, which is in itself already considered a DIR-method and which is a deviation from the default DIR setup. To see the effect of DMG-MoE trained on MAE would make it easier to compare it other methods.
Questions for authors
- Is A3 trained with fixed or only evaluated with fixed ? The question occurs because A3 numbers are identical to the ResNet-50 Vanilla in Table A.6
- Can you compare or discuss the result of UVOTE in context to your method?
- Can you isolate the effect of the Focal-R loss in contrast to using an MAE?
- Can you report mean and std across multiple seeds for AgeDB-DIR and IMDB-WIKI-DIR?
10 comments
Thanks for the reply, two follow up questions:
- How does your training configurations for UVOTE differ from other UVOTE implementations?
- I don't understand the results for the MAE and Focal-R comparison. The response says that all settings are unchanged and in the paper it says that focal-r is used as the regression loss, how does the results for Focal-r now differ so much to the numbers in the paper? For example, in the rebuttal you are reporting 12.511 for few-shot on AgeDB but in the paper you are reporting 9.62
I also just realized you changed the text in A.5 describing which loss you used. In the original version you reported Focal-R and in the revised version you are reporting "absolute error". Why have you done this? In the first table in the rebuttal you report that DMG-MoE + MAE actually worsens few-shot performance on AgeDB and IMDB in comparison to Vanilla.
Response to Reviewer oJMr
Thank you for your thoughtful review and for recognizing the novelty of our idea, the motivation behind our method, and the presentation of our paper. Your comments encouraged us to further strengthen the experimental comparison by including UVOTE and reporting results over multiple runs.
In the revised manuscript, changes addressing your comments are highlighted in light blue. Changes addressing comments from multiple reviewers are highlighted in light gray.
Q1. Training of A3
(Q1) Is A3 trained with fixed π or only evaluated with fixed π? The question occurs because A3 numbers are identical to the ResNet-50 Vanilla in Table A.6.
Response:
Thank you for this question. In the original manuscript, A3 was trained with fixed π that assigned all prediction weight to the deepest expert. Your question prompted us to reconsider this comparison. We realized that the original setting does not directly examine the effect of routing at prediction time. In the revised analysis, we train DMG-MoE with learned routing and fix the routing weights to the deepest expert only during evaluation. We have clarified this setup in Appendix A.8.2.
W1. Comparison with UVOTE and experimental reliability
(Q2) Can you compare or discuss the result of UVOTE in context to your method?
(Q4) Can you report mean and std across multiple seeds for AgeDB-DIR and IMDB-WIKI-DIR?
Response:
Thank you for pointing out UVOTE as an important baseline. The UVOTE results you cited achieve lower All, Med. and Few MAE than the DMG-MoE results in our original submission on AgeDB-DIR. These results were obtained under different training configurations, which may contribute to the observed differences. Following your suggestion, we have added UVOTE to the comparison and evaluated it on both image datasets. We also report the mean and standard deviation over three runs in Table 1.
The updated results are shown below.
DMG-MoE achieves lower mean All and Many MAE on both datasets, while UVOTE achieves lower mean Med. and Few MAE, suggesting that UVOTE performs better on the less represented groups in these comparisons.
W2. Effect of Focal-R and MAE
(Q3) Can you isolate the effect of the Focal-R loss in contrast to using an MAE?
Response:
Thank you for this suggestion. To isolate the effect of Focal-R, we compare DMG-MoE trained with MAE and Focal-R, while keeping the other settings unchanged. The results report the mean and standard deviation over three runs. Compare to MAE, Focal-R reduces the mean All and Few MAE on both datasets, with larger reductions in the Few-shot groups.
Additionally, following your suggestions and those of the other reviewers, we also evaluated combinations of DMG-MoE with other DIR methods. The combinations with PRIME and RankSim greatly improve upon the corresponding individual methods on both datasets (Table A.21). Based on these results, we finally select DMG-MoE with PRIME for the revised main comparison and use MAE instead of Focal-R as the regression loss.
Thank you again for your constructive comments and suggestions. We hope that our responses and revisions address your concerns. If you have any further experiments or analyses you would find helpful, we would be glad to provide them and discuss the results with you to support your assessment of our work.