- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes SketchHMR, a two-stage framework for recovering a 3D human mesh from a freehand sketch. The first stage uses conditional latent flow matching to generate a camera-aligned grayscale SMPL projection. The second stage predicts SMPL pose, shape, and camera parameters using an iterative regressor adapted with paired clean and generated projections. Experiments on Sketch3D evaluate reconstruction accuracy and the effects of the projection bridge and mixed-domain adaptation.
Critical strengths
- Clear presentation. The paper clearly explains the motivation, two-stage pipeline, and training procedure. The explicit intermediate projection also makes the reconstruction process easier to inspect.
- Well-organized experiments and modest computational requirements. The experiments examine the projection bridge, mixed-domain adaptation, sampling configuration, and regressor backbone. Training GeoInk on a single RTX 4090 demonstrates a relatively accessible computational setup.
Critical weaknesses
-
Limited methodological novelty. The framework primarily combines established components: conditional latent flow matching, pretrained visual encoders, iterative SMPL regression, and mixed-domain adaptation. Although the combination is reasonable, the paper does not sufficiently establish a distinctive methodological contribution beyond this integration.
-
Missing comparisons with alternative two-stage pipelines. A natural alternative is to generate a human image conditioned on the sketch and then recover SMPL parameters using an existing human mesh recovery model. The paper does not compare against such a pipeline, leaving unclear whether the proposed grayscale projection provides advantages over a more conventional generated-image representation.
-
Insufficient justification of the second-stage regressor. Given the extensive literature on human mesh recovery, the authors should compare their ResNet-34-based iterative regressor with established HMR models fine-tuned on the same clean and generated projections. Such comparisons would clarify whether the current regressor is an effective design choice and whether the gains mainly arise from the intermediate representation and training protocol rather than the regression architecture.
Questions for authors
Same as weakness.
3 comments
Thank you for the clarification. While the response provides additional motivation for the design choices, my main concerns remain unresolved. The discussion of novelty largely reiterates the existing components and ablation results, without sufficiently establishing a distinctive methodological contribution beyond their integration. The stated advantages of grayscale SMPL projections over generated RGB images remain unverified without the suggested alternative two-stage comparison. Moreover, the ResNet backbone ablation does not substitute for comparisons with established HMR models trained under the same clean/generated projection protocol. Therefore, the response does not provide sufficient additional evidence to change my assessment, and I maintain my original rating of 2 (Weak Reject).
Clarification: I write this review by myself.
We thank the reviewer for the constructive feedback and for recognizing the clarity of our framework and experimental analysis.
1. Methodological Novelty
The main contribution of SketchHMR is introducing an explicit, camera-aligned SMPL projection as an intermediate geometric representation between freehand sketches and human mesh recovery.
GeoInk combines spatial sketch latents with DINOv2 semantic features and input-anchored guidance to preserve body structure during projection generation. Unlike direct regression, this intermediate representation makes body geometry observable and allows sketch interpretation errors to be distinguished from downstream regression errors.
We further introduce paired clean/generated projection adaptation to address the domain gap between rendered and generated projections. As shown in Table 2, the projection bridge reduces MPJPE from 130.06 mm to 111.76 mm, with subsequent adaptation further reducing it to 96.60 mm under the original evaluation protocol.
2. Alternative Two-Stage Frameworks
We appreciate the suggestion to consider sketch-to-RGB-to-HMR pipelines.
Our grayscale SMPL projection is specifically designed to preserve geometry-related information, including body silhouette, articulation, and relative limb configuration, while minimizing appearance-related factors such as clothing, texture, and illumination.
This provides a structured, geometry-oriented observation for SMPL regression. We agree that comparing it with alternative intermediate representations would further strengthen the evaluation.
3. Choice of HMR Regressor
We adopt a conventional iterative SMPL regressor to focus on the contribution of the intermediate representation without introducing additional architectural complexity.
Our backbone ablation (Table 4) shows that ResNet-34 achieves 96.60 mm MPJPE, compared with 102.62 mm for ResNet-18 and 100.66 mm for ResNet-50, supporting its selection within the evaluated backbone family.
The proposed intermediate representation is not inherently tied to ResNet-34, and evaluating additional HMR backends would be a useful extension.
We thank the reviewer again for the valuable suggestions, which will help us further clarify the contributions and design motivations of SketchHMR.