- Rating
- 1(−2)
- Confidence
- 4(+1)
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1(−1)
Read review
Paper summary
EnergyMIL formulates WSI contextual modeling as a strongly convex energy minimization problem. It uses learned anchors for efficient global patch interaction, solves for a unique contextual state through iterative refinement, and combines focal and global evidence for slide classification.
Critical strengths
-
Mathematical formulation is clear and internally consistent. The paper gives a well-defined inner optimization problem. Under its assumptions, the contextual state has a unique solution and proximal refinement converges linearly to that solution. The theory matches the actual model design rather than being added only as an explanation after the fact.
-
Anchor-based global coupling is practical for WSI data. Direct patch-to-patch interaction can be expensive for thousands of patches. EnergyMIL routes communication through a small set of learned anchors, which allows global interaction while keeping memory roughly linear in the number of patches.
-
Method is relatively lightweight. EnergyMIL has 0.535M parameters and 2.63G profiled FLOPs under the reported setup. This is much lower than several Transformer-based MIL methods while still allowing slide-wide interaction.
-
The experimental comparison is reasonably broad within MIL. The paper compares against many recent MIL methods using the same CONCH features and the same five-fold splits. It also provides component ablations, parameter sensitivity, spatial visualizations, and paired slide-level statistical tests.
-
The authors report uncertainty more carefully than many MIL papers. They do not rely only on average fold scores. They also perform paired bootstrap and permutation tests against MammothMIL and clearly state when statistical significance is limited.
Critical weaknesses
-
Core mathematical idea is mainly transferred from implicit and equilibrium models. Defining a representation as a fixed point or optimization solution, guaranteeing uniqueness, and using iterative solvers are established ideas from DEQ, monotone operator networks, and energy-based implicit models. Therefore, the main novelty is the WSI-specific formulation and anchor coupling, not the general idea of an optimization-defined representation.
-
This paper does not fully show that the equilibrium formulation itself is necessary. The strongest ablation effect comes from anchor coupling. In contrast, the gain from detached multi-step state refinement is much smaller. This means the experiments support the usefulness of global contextual interaction more strongly than they support the need for a strongly convex equilibrium state. A direct comparison with a matched finite-depth residual model using the same anchors, feature map, and readout would be important.
-
Primary datasets are small. The four main datasets contain only 111, 192, 225, and 109 slides. The reported standard deviations mainly reflect variation across folds, not variation across independent training runs. This limits how strongly model stability can be concluded.
Questions for authors
Released code :1. The held-out fold is used for both model selection and final evaluation. The code evaluates the held-out fold after every epoch and selects the checkpoint with the highest held-out accuracy. This allows test-fold information to influence model selection and may lead to optimistic performance estimates. 2. Reported parameter count does not match the released implementation. The paper reports about 0.535M parameters, while the released default model contains about 0.470M parameters. This difference should be explained.
3 comments
-
Test-set leakage is a serious methodological flaw that directly undermines the reliability of the paper's main experimental results. The authors should rigorously re-evaluate and correct the results reported in the submitted manuscript under a proper evaluation protocol. This is a serious issue that requires concrete corrective action, not empty promises.
-
Authors have not provided a sufficiently substantiated and verifiable explanation for the discrepancy between the reported parameter count and the released implementation. Their current response remains unconvincing.
-
Authors have not substantively addressed the Critical Weaknesses raised in my original review.
Given these unresolved concerns, I have decided to lower my rating.
We acknowledge the shortcomings in our assessment and consider this report a valuable lesson learned. Thank you.
Thank you for identifying this issue so clearly. It is a lesson we will carry into future method development, including code review, evaluation design, and validation on larger datasets. In light of your comments and the earlier reviews, we have revised and reorganized our response. We recognize that these revisions do not resolve the methodological flaw. They reflect our effort to examine it honestly and account for what went wrong. Thank you again for your time and candid feedback.
We acknowledged the checkpoint selection limitation and will align the reported parameter count with the released code.
We thank the reviewer for the reassessment. We agree that selecting checkpoints by held out fold accuracy was a serious oversight in our experimental design. Our previous reply was inadequate, and we regret that. We accept that the submitted ranking lacks independent evaluation.
1. Checkpoint selection. All methods selected checkpoints by held out fold accuracy. This shared rule still allowed test information to influence model selection. We examined the two baselines with the highest submitted AUC on each dataset. Each cell shows submitted AUC followed by AUC at epoch 100, averaged over five folds.
EnergyMIL retains higher epoch 100 AUC than these baselines, but this subset cannot establish an overall ranking. On TCGA KICH, MR-Block and RRT-MIL reach 0.617 and 0.607, above EnergyMIL's 0.596. ACC and macro F1 also change materially. Epoch 100 was not selected by independent validation. A corrected comparison requires validation within each outer training fold to select checkpoints for every method, followed by one evaluation on the outer test fold.
2. Parameter count. Direct enumeration with a 512 dimensional input and two class output identifies the discrepancy.
The submitted 0.535M figure was incorrect. The correct size of the released model is 0.470M.
3. Mathematical contribution. We agree that equilibrium learning comes from prior implicit models. Our contribution is the WSI formulation and analysis.
These results specify the contextual state reached under fixed model parameters. They do not imply improved discrimination or generalization on their own.
4. Necessity of convergence. The one update control starts from zero and lacks cross patch interaction. We added fixed update controls with the same embedding, coupling, and readouts, plus a nearly parameter matched two layer residual anchor network.
On TCGA KICH, several updates improve all three metrics over one update. EnergyMIL exceeds the matched residual network in ACC and F1 on both datasets. Five or ten updates can match or exceed convergence based performance. The energy formulation supplies a unique contextual target, although fully reaching it is not necessary for the highest accuracy here. These controls share the original checkpoint rule and remain mechanism diagnostics.
5. Dataset size and stability.
The datasets cover distinct tasks. Two supplementary datasets add breadth. We agree that fold deviations from one training seed do not measure variation across independent runs. AURORA slide level folds do not establish generalization to unseen patients. We limit present claims to slide level observations. Future work will test EnergyMIL on larger WSI datasets with patient separated evaluation and independent validation. Those findings will guide further algorithm development.