- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
The paper addresses inverse-physics methods that predict material parameters from video inputs. Its main observation is that the absolute values of certain physical parameters cannot be inferred from observed motion alone. Specifically, the paper discusses elasticity and density, for which only their ratio can be inferred, rather than their absolute values. The paper argues that this limitation should be acknowledged in both the prediction and validation of video-based inverse-physics methods. It also investigates how existing methods nevertheless produce predictions of these absolute values.
Critical strengths
• The main motivation point raised in the paper is correct and clear: the community should consider whether the physical parameters predicted by video-based inverse-physics methods are actually identifiable from the video. • The paper investigates how absolute elasticity and density values are determined across several physics simulators.
Critical weaknesses
I find the paper to be very difficult to follow. I believe that improving this requires major revisions in the paper. The paper’s topic is outside my primary field of research, and I acknowledge that some of my criticism may stem from my limited familiarity with the field. Below are a few examples:
o Ideas are frequently expressed in overly complex and confusing language, even when they could be conveyed more simply. For example, “A datum that removes the symmetry must also couple to the realized motion for parameter values to be distinguishable” (line 215) could be simplified to “A datum that removes the gauge must have a noticeable effect on the motion observed in the video.”
o Another example of unnecessary complexity is Section 6. It seems straightforward that if density cannot be inferred from a video, then a predicted density value is not reliable, even if a density parameter is optimized within a physics simulator. I do not understand why an entire section is dedicated to this point. In my opinion, the sentence in lines 361–363 is sufficient to explain it.
o Many terms are not explained. For example:
-
“Boundary” repeats throughout but never explained. Same goes for “Classification”.
-
Lines 108-110: “gauge certificate” and “mass-scale transformations” are not explained. The sentence is unclear without defining these.
o Almost every paragraph begins with a short title, even in the Introduction, and many paragraphs are disconnected from those before and after them. This made the paper difficult to follow, as I often struggled to understand how the different paragraphs relate to one another and how the paper's argument develops.
o Some of the paragraph titles are confusing. For example, "The protocol determines the boundary" (line 78) is unclear, as I could not understand which protocol or boundary it refers to.
o Semicolons are overused improperly, resulting in long difficult-to-follow sentences. For example, line 113.
In addition, I believe the paper's contribution is too narrow:
o The main contribution is highlighting the inability of video-based inverse-physics methods to estimate the absolute values of elasticity and density. However, as far as I understand, this limitation is well-established in physics: the absolute values of elasticity and density cannot be inferred from video alone, and only their ratio can be determined (Feng et al., 2022), unless additional information is available. The implication for evaluation is immediate: evaluating the accuracy of absolute elasticity and density predictions means evaluating quantities that cannot be uniquely determined from the video.
The paper also investigates how different methods produce these absolute values, which is interesting. However, in my opinion, this analysis has limited practical value, as we know predictions cannot be reliable from the video alone.
Overall, I do not think the contribution is broad enough, as the paper mainly points to a known problem.
Questions for authors
I believe the paper could become stronger if it demonstrated how accounting for this limitation changes our understanding or evaluation of existing video-based inverse-physics methods. For example, would correcting the evaluation protocol change the ranking of existing methods? Could a method previously considered the best turn out to be inferior under a more appropriate evaluation?