- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
Not being a neuroscientist or psychologists I have a very hard time understanding what is done. The authors study the Ganzflicker records which I assume is a highly valuable resource in their field but not known to me. From what I understand the records are accounts of patients describing images from their memory and this is translated into a image to discuss with the doctor. Observation is that in the current dataset a lot of information that is in the records is not fully considered in the score that is given to an image. The paper is mostly considering questions like what information should be preserved in the image, whether structured prompts are useful or whether it is better to look for similar records.
Critical strengths
- The work might be relevant from a psychology / neuroscientist point of view. Especially if this dataset is used as standard reference while not being optimal.
- Careful study of different characteristics of the dataset and where it could be improved.
Critical weaknesses
- Although it is submitted to the track applications in neuroscience and cognitive science I find it hard to see the match to ICLR.
- The results of the study are only relevant for the dataset but it remains unclear how this would extend to the general scope of people describing images from memory (e.g. for retrieval), or better ways to go from prompt to image.
- Text is not really accessible for the regular ICLR audience.
Questions for authors
- What are the implications of your work beyond the Ganzflicker dataset?