- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces TriViS, a dataset for continuous Vietnamese sign language recognition and translation. It contains 12,000 sentences and 84,453 video clips recorded from three synchronized camera views in lab and real-world settings. The authors describe how they collected, annotated, and checked the data. They also extend SpaMo to combine the three views in a model called SpaMo-MV. The experiments compare camera views, test performance on unseen sentences, and study the effect of language model size. The appendix also tests SpaMo on unseen signers. The results show clear gains from multi-view input on lab data, while real-world settings and unseen signers remain difficult.
Critical strengths
-
TriViS fills an important gap in data for continuous Vietnamese sign language recognition and translation. Most existing resources focus on a small set of languages. TriViS provides videos, sentences, and gloss annotations across several topics. I think this dataset will be useful for training and testing future models for Vietnamese sign language. This is the main reason I lean toward acceptance.
-
The authors put care into data collection and annotation. Deaf-education specialists and Deaf signers helped prepare and check the gloss annotations. The data cover lab and real-world settings, with changes in recording sessions and clothing. The authors also describe how they split the videos into sentences, crop the signer, and check video quality. Recording the same signing performance from three views makes it possible to study what each view adds. In Table 3, three-view SpaMo-MV reaches 25.28 BLEU-4 on the lab subset, compared with 11.09 for single-view SpaMo. This supports the value of the recording setup.
Critical weaknesses
-
The dataset includes only four signers, and the original split has the same signers in training and testing. This limits what the results tell us about new users. I appreciate the leave-one-signer-out evaluation in the appendix. However, Table 6 shows that SpaMo's BLEU-4 drops from 11.09 on the original split to 5.00 ± 0.91 on unseen signers. The test also covers only SpaMo, so it does not show how much multi-view fusion helps with this problem. The paper should make this limit clear when discussing its main results.
-
The claims about multi-view benefits should be more specific. The largest gains come from lab data with three views available in both training and testing. In Table 3, three-view SpaMo-MV scores 2.60 BLEU-4 on real-world data. This is better than single-view SpaMo at 1.00, but below single-view GloFE at 6.03. When training uses three views but testing uses only the front view, lab BLEU-4 rises from 11.09 to 12.26, and not all other metrics improve. These results support a more limited claim than consistent gains across settings. The dataset is still useful, but the paper should be clear about when multiple views help and what this means for practical use.
Questions for authors
-
How are the overlap and unseen-sentence splits built? Please report the training, validation, and test sizes, and explain what is kept separate between them. Do these splits share signers? Are the three synchronized videos of each recording always kept in the same split? These details would help distinguish performance on new sentences from performance on new signers or camera views.
-
For the lab and real-world results in Table 3, are separate models trained for each setting? Or is one model trained on shared data and then tested on the two subsets? Please clarify this setup. It matters for understanding whether the performance gap comes from differences in training data, recording conditions, or other factors.