- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper studies unsupervised text segmentation. The method proposed is straightforward: 1) use a pretrained embedding model to convert each sentence into a vector, and 2) applies KCPD algorithm to identify positions where the distribution of these vectors changes, thereby achieving unsupervised segmentation.
The paper also considers potential dependencies between neighboring sentences and provides two theoretical results under the assumption of m-dependence. The experiments are mainly conducted on several text segmentation datasets and RAG retrieval tasks, where the proposed method generally outperforms the baselines.
Critical strengths
None.
Critical weaknesses
-
My first concern is why we should use this method in practice. There are already many simple and intuitive approaches, such as fixed-length chunking or directly splitting text based on the embedding similarity between adjacent sentences. However, the authors do not sufficiently demonstrate the advantages of their method over these simpler alternatives. Moreover, the actual improvements seem relatively small, while the proposed method requires substantially more computation. Therefore, I am not convinced that the additional complexity is justified.
-
Another concern is that the methodological novelty is relatively limited, as the paper does not introduce a new algorithm. As for the theoretical results, I think the m-dependence assumption is quite strong, which may limit their practical significance. In real language, dependencies can exist even between sentences that are far apart. Furthermore, when the authors use an LLM to generate text, even if they only provide the previous M sentences as context, this does not necessarily guarantee that the generated data actually satisfies the m-dependence assumption.
Questions for authors
- Why should we use EMBED-KCPD instead of simpler chunking methods?
- Is Theorem 3.11 actually non-vacuous?
- How does the theory apply to the actual experiments?
- Is the RAG comparison fair?