- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces a new egocentric multimodal benchmark named VISTA, which aims to assist blind and low-vision users. The most distinctive features of this dataset are its rich multimodal signals and goal-driven action instructions. Experiments on this dataset reveal that goal-driven assistance can potentially raise safety issues. However, the involvement of blind and low-vision people is very limited. Without careful involvement from this community, this dataset could be just another general egocentric dataset.
Critical strengths
Rich multimodal signals and a focus on assistance for blind and low-vision people (although not validated).
Critical weaknesses
- Limited involvement of the blind and low-vision community. To build these kind of dataset, feedbacks from these specific community is most important. For example two prior work established the involvement of these communities [1, 2].
- Potentially inappropriate modalities, such as gaze and IMU. Gaze and IMU signals collected from sighted people might not be helpful for blind and low-vision people.
[1] Xiao, Junbin, et al. "Egoblind: Towards egocentric visual assistance for the blind." Advances in Neural Information Processing Systems 38 (2026). [2] Song, Inpyo, et al. "Video question answering for people with visual impairments using an egocentric 360-degree camera." arXiv preprint arXiv:2405.19794 (2024).
Questions for authors
Did the construction of this benchmark involve blind and low-vision people? As I understand it, the paper includes only one reviewer from this community, who reviewed 27 clips and 34 annotations (a very small proportion of the benchmark).