- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper introduce EventGauge a physical audit that withholds a calibrated displaced camera until reconstruction is frozen. The audit asks whether the finished reconstruction is best supported at the true physical viewpoint and whether that support is sharp enough to justify a metric conclusion. The method retaining trajectory-scale information while evaluating a frozen reconstruction from a withheld calibrated camera.
Two complementary checks are performed. The trajectory check keeps the reconstruction-to-metric conversion absorbed by similarity alignment and reports the residual when rescaling is forbidden. The image check then tests the frozen scene under that conversion using a displaced camera withheld from reconstruction and scale fitting. With EventGauge a sharp response can support a metric conclusion
Critical strengths
Proposing a 'aduit' is interesting and novel, I never read paper like this before.
The paper makes an interesting distinction between selecting a scale, producing scale-sensitive scores, and independently validating physical scale.
The prespective of withheld camera is insipiring.
The M3ED cases demonstrate why geometric parallax alone does not establish useful precision is also a valid point.
Critical weaknesses
This reviewer is confused about what is an 'audit'. Is this a benchmark? an error metric? or new dataset? Read through the paper, seems like 'audit' is a way of desiging a benchmark, but the authors do not actually provide a benchmark?
If I understand correctly, the 'audit' still need an oracle which is the metric scale offset information about the leave out camera. So this bascially means we have a matric scale reference, and the rest is how we should align to this reference?
Nevertheless, the paper is extremely difficult to follow. I think the authors may need more effort to better 'position' the paper and tell the read what is an 'audit'? It seems that the paper is talking about a new systematic way to measure the metric scale reconstruction? Is this a proposal for the follow up research? What is the problem of having other direct metric scale evaluation? because neverthelss it seems the method actuall still need a full metric scale dataset to test with?
Questions for authors
What is considered to be the techinal contribution of the paper?
What do you mean by 'scientific outcome' ? what is 'uncensored response' ?
Who should use EventGauge, or when it should be used? What is the difference than comparing the actual metric scale error metric?
How to determine a peak is sufficiently near one and sufficiently narrow to support a stated metric precision?
How to determine the reconstruction length unit in the IncEventGS comparison?