- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
FLiTo improves one- and few-step LiTo generation using image reconstruction, teacher distribution matching, and additional image-space losses.
Critical strengths
- The single-step results show a substantial improvement in both input fidelity and novel-view quality.
- Comparisons with MeanFlow and DMD on the same backbone support the value of image supervision.
- The paper also provides useful loss ablations and detailed runtime breakdowns.
Critical weaknesses
- The method is evaluated only on LiTo. Testing MeanFlow and DMD initializations does not establish whether the gains transfer to other 3D backbones or representations.
- The benefit of human-preference supervision is unclear: removing it improves every reported metric in Table 6, including HPS.
Questions for authors
- Why retain the HPS loss when removing it improves all metrics in Table 6? Does it help in longer training or human evaluation?
- Can you directly evaluate geometry for the full and no-KL variants? Teacher likelihood alone does not establish geometric quality.
- Which KL-gradient sign is used in the implementation, Eq. (3) or Eq. (18)?
4 comments
Author response — Part 2
KL and geometry. As suggested, to measure the quality of 3D geometry, we have calculated Uni3D metrics for a few informative runs (please see below), and will add complete numbers for all runs in Table 2 and 6. We also added new Figure 10 and 11 to visualize the effects of the KL regularization.
To start, in Table 2, when we finetune a base MeanFlow model with the conditioning reconstruction loss (+cr) and additionally with the KL regularization (+cr + kl), we observe that the model trained without KL produces worse novel view metrics and worse Uni3D score (0.343 vs 0.353). Without KL, the geometry deteriorates further with additional training --- with just twice the iterations, objects are often generated without a backside, as visualized in the new Figure 10(a); this is reflected in a Uni3D score of 0.302 without KL, versus 0.354 with. We hypothesize that when only the conditioning reconstruction loss is used, the backsides are sacrificed to maximize frontside performance due to the limited model capacity of few-step models. The model with KL regularization does not suffer from such artifacts.
Under our full recipe that has additional objective terms, the geometry-preserving aspect of the KL term is less prominent --- the model trained without KL has a Uni3D score of 0.367 and that with KL has 0.364, well within the standard deviation of 0.06. Nonetheless, other benefits of the KL term become more prominent.
First, we observe that the KL regularization helps preserve view-dependent appearances in the generated objects. Specifically, when we remove the KL regularization from our full recipe (i.e., -kl in Table 6), the model tends to bake view-dependent highlights into the diffuse appearance, as shown in the new Figure 10(b). To the best of our efforts, we could not find a metric that measures view-dependent appearance, and we used NLL as a proxy. To help quantify this effect, we added a new Figure 11(a), which shows the average energy of the spherical harmonics coefficients of different degrees of the Gaussians in the generated objects across the test set. As we can see, removing KL from the recipe results in a higher 0th-degree energy and lower higher-degree energy, indicating the loss of view-dependent effects. We appreciate any suggestions on a metric that might better capture this loss of view-dependence.
Second, we observe that without the KL term, the proposed 2D supervision can push generated latents out of the original 3D token distribution. This can degrade the performance of downstream decoders that are not utilized during our training. As shown in the new Figure 10(c) and 11(b), an illustrative example is the point cloud, flow-matching-based decoder of the LiTo representation. LiTo uses this decoder to supervise 3D geometry during tokenizer training --- however, to produce Gaussian splats during inference, they use an independently-trained occupancy decoder for efficiency. We similarly use this occupancy decoder for our decoded Gaussians in our training pipeline, and we do not use the point cloud decoder. Ideally, an occupancy grid inferred from the point cloud decoder should roughly match that of an occupancy decoder --- we find an average Intersection over Union (IoU) of 0.778 on the ground-truth tokenizer output from our test set. However, after training without the KL regularization, the two decoders begin to diverge from each other --- we observe an average IoU of 0.572 without the KL term, versus 0.783 with the KL term which is closer to the reference from the ground-truth tokenizer (Figure 11(b)). This visually manifests as a visible bias in the point cloud decoder output, which is visualized in a new Figure 10(c).
We have expanded the discussion of the subtractive ablation to include the above, and we will add the Uni3D, SH-degree and decoder IoU metrics for all runs in Table 2 and 6. We believe these observations support our derivation in Section 3.1 and the use of KL regularization.
Author response — Part 3
KL-gradient sign inconsistency. We apologize for the typo. The correct expression should be the one in the appendix, i.e., the negative of the original Equation (3), which is now fixed in the current manuscript. We use the correct expression in our implementation, as reflected by the findings above.
Other improvements to the paper. We also made a few other improvements to the paper compared to the original version. First, we have updated Table 1(b) with larger-scale checkpoints of our 4-step models, which results in further improved metrics. Second, in Table 3(b), we accidentally used an incorrect result for “ours (meanflow init)” --- the correct numbers correspond to better input view metrics and novel view FID. Third, we added a new Figure 3, which compares the results of our 1-step model with the 1-step MeanFlow base model and highlights the benefits of our recipe. Additionally, we have slightly expanded the related work, primarily in terms of past methods of 2D supervision for 3D generation. Finally, we have fixed typos and improved writing throughout the paper.
Thanks for the response, I will keep my rating.
Author response — Part 1
Thank you for the careful review and the comments --- we do our best to answer your questions below. Please let us know if you have any remaining thoughts or concerns.
Scaling beyond LiTo. We agree that demonstrating our method on approaches beyond LiTo would make our work stronger. However, for our current framework to be most effective, it requires certain properties for the initial base model that most existing baselines do not satisfy. For one, it requires that the generated objects, when rendered from a consistent camera pose, produce an image aligned with the input image. This is not only required for the conditioning reconstruction loss, but also maximizes the performance for the other rewards, e.g., it allows for aligned ground truth and rendered novel views for feature-distribution matching and paired human-preference supervision. Unfortunately, many approaches output generated 3D assets in a canonical world frame rather than in the conditioning camera’s coordinate system, e.g., most TRELLIS-type approaches. Some approaches also output the pose of the conditioning camera (e.g., SAM3D), but we found their performance to be quite poor in the few-step setting --- in fact, in our evaluations, we had to run slow post-generation pose optimization for meaningful results (sec. C of the appendix). LiTo performed the best in our experiments, as it explicitly predicts the generated object in a consistent coordinate system with the conditioning view on the x-axis.
Secondly, a latent space for the generative model that is capable of replicating the real image distribution is desirable for our framework. In our experiments, we found most popular existing baselines suffered from various appearance artifacts. Public checkpoints of TRELLIS and SAM3D suffer from significant color shift, which can be attributed to the lossiness of their DINO-based framework (Singh et al., 2026). Mesh-based approaches, e.g., TRELLIS-2, output PBR materials, which not only require accurate lighting but also generally struggle to replicate real-world appearance. On the other hand, LiTo directly parameterizes the surface light field, which allows the base model to already well-replicate realistic appearance.
While overcoming these view-alignment and latent-space challenges is not impossible with sufficient engineering, given the limited paper (and rebuttal) timeline, we decided to primarily build upon LiTo for our experiments. We have updated Sec. 4.1 to describe these desired properties. We leave extending the ideas of our paper to other base models as interesting future work.
Why HPS? Even though removing HPS improved our metrics in our small-scale subtractive ablation, we opted to keep it for our full-size run for a few reasons. First, we observed that it was helpful in our additive ablation --- as shown in Table 2, it improves preference metrics and slightly improves novel-view metrics over a base model. Second, qualitatively when HPS was removed, we observed a slight “flattening” of generated assets that we found to be an indicator of later collapse in our earlier experiments (and does not typically present in the metrics). To better quantify this, we computed the ratio of the extent along the x-axis (i.e., depth direction) of generated objects relative to the mean of their y- and z-extents. On the test set, the average ground-truth ratio is 1.064. We found an average ratio of 1.078 for our full recipe vs 0.888 for the run without HPS, indicating consistent flattening.
Finally, from a more philosophical point-of-view, HPS fills an important gap relative to the other 2D rewards we propose. The conditioning reconstruction loss provides strong supervision on the front-side of an object. For novel views, feature-distribution matching provides coarse, distribution level supervision, while the semantic consistency loss provides a rough conceptual training signal. From that perspective, HPS provides complementary, low-level supervision for the visual quality of a novel view. We believe a human-preference model that is easier to backpropagate through than the current HPSv3 model would likely significantly improve the quality of our results.
To clarify these points, we have added a new Figure 12 illustrating the slight flattening without HPS to the appendix, and will refine the discussion in the paper to better highlight our conceptual reasoning for HPS. Unfortunately, we do not have the resources to complete a full training run without HPS within the time limits of the rebuttal period.