- Rating
- 3
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The authors propose FMGRPA, a two-stage pansharpening framework combining conditional flow matching (CFM) with group relative preference alignment (GRPA). CFM learns a PAN-guided conditional flow from LRMS to HRMS, while GRPA refines the base prediction through structured candidate construction, hybrid rewards, and spatial and temporal preference aggregation. Experiments on WV2, WV3, and GF2 demonstrate competitive performance, with ablation studies validating the effectiveness of the proposed components.
Critical strengths
1.The proposed framework explicitly addresses the spectral and spatial fusion preferences in pansharpening, rather than relying solely on conventional reconstruction objectives.
2.The proposed GRPA is simple and intuitive, constructing spectral, spatial, and balanced candidates by adjusting LRMS low-frequency content and PAN high-frequency details without requiring separate prediction branches.
Critical weaknesses
The necessity of the CFM formulation is not sufficiently justified. Moreover, the paper lacks a direct end-to-end reconstruction baseline without CFM and time conditioning, making it difficult to assess the actual contribution of the CFM formulation.
Questions for authors
1.Could the authors clarify the motivation for predicting the HRMS image and deriving the velocity from it, rather than directly predicting the conditional vector field as in conventional flow matching?
2.What motivates the use of the L1 velocity matching term combined with the SSIM loss in Eq. (3)? Could the authors provide further justification for this objective?
3.Could the authors provide an ablation study using a direct end-to-end reconstruction model without CFM and time conditioning to demonstrate the necessity and effectiveness of the proposed CFM formulation?
4 comments
Thanks for your rebuttal. I would like to further clarify my questions. First, why is L1 used instead of the squared L2 commonly adopted in CFM, which has a theoretical basis for learning the marginal velocity field? Second, since the model directly predicts HRMS and uses only one step for inference, could a direct end-to-end reconstruction model combined with GRPA, potentially using simpler techniques such as dropout or noise perturbation, achieve similar results?
Response to Reviewer sBnX (Round 2, Part 1 of 2)
Thank you for carefully reviewing our response and further clarifying these two questions. Below, we provide specific explanations for both questions.
Q1. Why use L1 rather than the squared L2 loss commonly used in standard CFM?
The goal of pansharpening is to reconstruct a high-resolution multispectral (HRMS) image that preserves the spectral information of LRMS while incorporating the spatial details of PAN. We let the network directly predict this image so that each query yields a complete HRMS image that can be used for supervision and candidate construction. During training, SSIM directly compares the local structure of this image with that of the reference HRMS image, constraining the recovery of edges and textures. GRPA uses this image as the basis for constructing spectral, spatial, and balanced candidates from the low-frequency residuals of LRMS and the high-frequency details of PAN, and compares the fusion quality after each correction. Thus, directly outputting HRMS allows the same prediction to serve image-structure supervision, candidate construction, and final reconstruction. The predicted velocity is obtained by subtracting the upsampled LRMS starting point from the predicted HRMS, while the target velocity is obtained by subtracting the same starting point from the reference HRMS. Therefore, the L1 error between the two velocities is exactly equal to the pixelwise absolute error between the predicted and reference HRMS images, allowing velocity supervision to directly constrain the reconstruction error at each pixel in each band.
Our specific motivation for choosing L1 is to control how errors of different magnitudes affect optimization. For squared L2, the gradient magnitude for an individual error term increases with the error magnitude, whereas for L1, it does not. This limits the dominance of a small number of pixels with large errors in the updates. Meanwhile, pixelwise errors cannot fully distinguish the spatial distribution of errors. Similar pixelwise errors may correspond to different degrees of edge blurring and texture loss. We therefore incorporate SSIM to compare the local luminance, contrast, and structure of the reconstructed and reference images, providing complementary supervision for edges and textures.
Standard CFM regresses path velocities using squared L2, whose conditional-mean property provides a theoretical basis for learning the marginal velocity field. We retain conditional probability path sampling and the corresponding velocity targets, and use endpoint parameterization to formulate the training objective as L1 and SSIM tailored to HRMS reconstruction. This choice is motivated by the optimization properties of reconstruction errors, while the conditional-mean result for squared L2 relies on its specific loss assumption.
Response to Reviewer sBnX (Round 2, Part 2 of 2)
Q2. Can direct reconstruction combined with GRPA, supplemented by dropout or noise perturbation, achieve similar results?
Thank you for proposing this specific alternative. We consider your proposed combination of direct reconstruction and GRPA to be feasible, and dropout or random noise can also introduce more variation during training. On this basis, our method further uses paired LRMS and HRMS images from the same scene to construct a conditional probability path, so that training inputs at different times contain different amounts of target information. In this way, input variations have an explicit reconstruction direction and degree of interpolation, enabling the model to jointly learn to recover the same HRMS image from different intermediate states. Near the starting point, the model needs to recover more details from states close to LRMS. Near the endpoint, the model needs to complete reconstruction from states containing more HRMS information. Time conditioning informs the model of the current degree of interpolation, and the same network jointly learns these related reconstruction tasks, thereby obtaining more diverse training inputs and reconstruction supervision with the same number of training image pairs.
Dropout introduces variation by randomly masking features, while ordinary noise perturbation introduces variation by randomly changing the input. Neither operation by itself uses the paired HRMS image of the current scene to organize training states along a path from LRMS to HRMS, nor does it provide information about the corresponding degree of interpolation. Our path-based training therefore gives time conditioning an explicit meaning. In the second stage, we fix the same LRMS and PAN observations and separately read out complete HRMS predictions under different time conditions near the start of the path. GRPA constructs and evaluates spectral, spatial, and balanced corrections under each time condition, then aggregates the weights for the same type of correction, reducing the dependence of candidate weights on scoring under a single time condition.
In our response to your previous Question 3, we provided a comparison between CFM and end-to-end direct reconstruction on GF2. Both use the same NAT backbone, L1 and SSIM losses, training budget, and evaluation protocol. Direct reconstructs HRMS from upsampled LRMS with time conditioning disabled. CFM learns reconstruction from time-conditioned interpolated states. This comparison evaluates the reconstruction performance of the two training approaches before adding GRPA.
| Method | Training input | Time conditioning | PSNR ↑ | SSIM ↑ | SAM ↓ | ERGAS ↓ |
|---|---|---|---|---|---|---|
| Direct | Upsampled LRMS | No | 48.6278 | 0.9872 | 0.0104 | 0.5002 |
| CFM | Interpolated state | Yes | 48.8446 | 0.9878 | 0.0098 | 0.4862 |
CFM achieves gains over Direct on all four reconstruction metrics.
Response to Reviewer sBnX
Thank you for your valuable comments. Your feedback helped us identify where the paper needs further clarification and improvement. We will revise the paper accordingly and respond to each point below. Please let us know whether we have addressed your questions.
Q1. Why predict the HRMS image before computing the velocity?
GRPA needs to compare the spectral and spatial quality of candidates under the same observations. Conventional CFM integration starts from the same observation and traces a single reconstruction trajectory. Scoring intermediate states directly along that trajectory would conflate candidate quality with reconstruction progress. Continuing the integration from those states to the endpoint along the same trajectory would yield the same fused image. To construct and compare candidates, we therefore hold the upsampled LRMS L fixed and query the model at different time conditions t, obtaining one complete HRMS image per query.
Given L, image and velocity predictions can be converted into one another using Eq. (2). The predicted velocity and the LRMS starting point allow one-step image reconstruction, as in OTFM (Cao et al., ICCV 2025, §3.3). Our implementation uses an image parameterization to directly obtain a complete HRMS image X^ at each time condition and then computes the velocity as sθ=X^−L. JiT (Li and He, CVPR 2026, §4.3) likewise derives the velocity from the predicted image for supervision.
Q2. Why combine the L1 velocity matching loss with the SSIM loss?
The velocity term in Eq. (3) computes the mean absolute difference between the predicted velocity sθ and the target velocity ut, constraining the reconstruction correction at each pixel in each band. When errors are summed pixel by pixel, errors distributed continuously along object boundaries and errors scattered across flat regions may yield similar L1 losses. The former are more likely to blur object contours. With SSIM, the training objective also compares the local luminance, contrast, and structure of the predicted and reference HRMS images, encouraging consistency in edges and textures.
To isolate the contribution of the SSIM loss, we compare two settings for first-stage CFM on GF2. Both use the same NAT backbone, interpolated states, time conditioning, training budget, and evaluation protocol. The ablation sets the weight of the SSIM loss in Eq. (3) to zero and retains the L1 velocity matching loss.
Adding SSIM improves structural consistency, and the spectral angle remains essentially unchanged.
Q3 and the main concern. What does CFM contribute to first-stage reconstruction?
To assess the contribution of CFM, we designed a comparison on GF2 between first-stage CFM and end-to-end direct reconstruction (Direct). Direct starts from the upsampled LRMS L, reconstructs HRMS directly under PAN guidance, and uses no time conditioning. CFM learns to reconstruct from interpolated states Xt with time conditioning. Both settings use the same NAT backbone, L1 and SSIM losses, training budget, and evaluation protocol.
In the comparison with the same backbone and training budget, CFM, which is trained on path states and uses time conditioning, outperforms Direct on all four reconstruction metrics.