- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes MCANO, a Mamba-based neural operator for time-dependent PDE prediction. The architecture separates pointwise temporal feature construction from spatial modeling: TAM combines polynomial temporal lifting with an MLP, while SA-Mamba integrates fixed and content-adaptive scans to process spatial features. The authors further introduce MCANOP, a framework for multi-PDE pretraining and task-specific fine-tuning. MCANO is evaluated on nine PDE datasets, including irregular-domain and long-horizon settings, with ablation studies assessing the contributions of its core modules. The reported results show competitive prediction accuracy and substantial benefits from pretraining followed by fine-tuning, including on downstream PDE datasets excluded from pretraining.
Critical strengths
- Generalizability of the pretraining–fine-tuning paradigm: Pretraining followed by task-specific fine-tuning considerably improves prediction accuracy over training from scratch. The model also achieves competitive results after fine-tuning on downstream PDE datasets excluded from pretraining. These findings support its potential utility across a range of prediction tasks.
Critical weaknesses
-
Unclear motivation and research gap: The paper does not clearly articulate the specific limitations of existing methods, including prior Mamba-based PDE solvers. Accurately modeling spatiotemporal dependencies is a broad objective shared by essentially all approaches to time-dependent PDEs. This framing leaves the manuscript’s motivation and the concrete problem addressed by the proposed method insufficiently clear.
-
Insufficient validation of the proposed design mechanisms: For example, the adaptive scanning module is intended to make information propagation better reflect the spatial organization of the physical field. Although the ablation results demonstrate improved prediction accuracy, they do not establish whether the module achieves this intended behavior. The paper lacks visualizations of the learned sampling locations and scan paths on representative physical fields.
Questions for authors
-
Translation and rotation equivariance: When a physical scenario is translated or rotated, do the model’s predictions undergo the corresponding transformation? Could the authors clarify how the spatial encoding and scanning schemes affect these properties?
-
Scalability to 3D: How would the fixed and adaptive scanning schemes extend to three-dimensional domains, and would their computational and memory costs remain practical as volumetric resolution increases?
-
Transfer across geometries and boundary conditions: Can the pretrained model transfer to domain geometries or boundary conditions absent from pretraining? For example, can pretraining on simple geometries facilitate adaptation to more complex domains formed by combining basic shapes?
I consider the paper technically complete overall, with my main concerns being the unclear motivation and insufficient validation of the proposed modules’ design rationale, as discussed in the weaknesses. I would raise my score if the authors clearly articulate the motivation in the abstract and introduction and provide evidence that the modules achieve their stated design objectives.