- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper introduce the GlassSeaerch-Bench, which evaluates smart-glasses search assistants using task-specific rubrics. Experiments include a 500-task archive covering 4 products, an 18-task development study, and a 90-case construction replay.
Critical strengths
None.
Critical weaknesses
-
Poor writing. This paper is difficult to follow.
-
Product comparisons cannot isolate the causes of performance differences. Many factors can affect product's performance, but the experimental design does not explain how the evaluation can be reproducted
-
There is a lack of the detail about the sources of the human label and validation procedure. And It is necessary to report the agreement between the automated evaluation and the expert evaluation.
Overall, I believe this paper need to be carefully revised.
Questions for authors
See Weaknesses.