- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
MSO is a neural operator that combines a multi-scale feature pyramid, local attention, and a query-based decoder. The paper reports improvements on five 2D PDE benchmarks, with different levels of improvement across the tasks.
The experiments show that this combination of multi-scale features and sparse query decoding can achieve good accuracy on these 2D PDE tasks.
Critical strengths
-
Each query only looks at features, instead of all the spatial tokens.
-
The design makes sense. It puts together some common methods, like multi-scale features, bidirectional propagation, Window Attention, and Cross-Attention. The results are quite good.
Critical weaknesses
MSO does not really have lower computational complexity than single-scale Local Attention. Instead, it adds multi-scale encoding and feature propagation to get a larger receptive field. This makes sense from an architecture design perspective, but it also brings extra computational cost.
The experimental results are quite good, but I think there are still some important things missing. First, there is no fair comparison under the same number of parameters, FLOPs, and training budget. The paper also does not provide enough information about the actual training and inference efficiency. Most of the complexity analysis focuses on the Query Decoder, rather than the whole model. Also, some datasets require millions of training updates, so having fewer parameters does not necessarily mean the model is more efficient.
Another concern is the generalization ability. The paper does not test the model across different resolutions, so it's hard to say whether it is really resolution-independent. All experiments are also based on regular 2D grids, without testing more complex geometries, unstructured meshes, or 3D problems. Besides, there are no experiments with multiple random seeds, so we don't know how stable these improvements are.
One more thing is that the multi-scale hierarchy itself is fixed. The model does not actually learn how to divide the spatial scales. What is adaptive is only how the model combines features from different scales through attention. So I think the paper should be more careful when discussing the advantages of its adaptive multi-scale design.
Questions for authors
Would MSO still perform better than a deeper or wider single-scale Window Attention model if they have the same FLOPs, GPU memory usage, and number of parameters?