- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposes MTSTab, a tabular representation learning framework that constructs systematic representations from two complementary views: statistical and semantic. The statistical view performs data-driven column partitioning, while the semantic view leverages semantic information to partition columns rather than relying on heuristic grouping strategies. The paper empirically demonstrates that MTSTab achieves strong performance across several downstream tasks, including anomaly detection, classification, and regression.
Critical strengths
- The paper introduces a hard-negative sample synthesis strategy that preserves the marginal distribution of each column. This makes the synthesized samples more difficult to distinguish using shallow linear models.
Critical weaknesses
-
In the Introduction, the paper claims that the proposed method can provide "human-level" semantic priors. However, this claim requires stronger justification. In particular, the paper should provide a more explicit discussion of why LLM-generated embedding vectors derived from column metadata can be regarded as providing human-level semantic information. Without further evidence or analysis, I believe that this claim is somewhat overstated.
-
(Major) Sections 3.2, 3.3, and 3.4 introduce a large number of notations without sufficiently explicit definitions in the main text. Examples include , , , , and even the VICReg loss. This significantly reduces the readability of the methodology section and makes the proposed framework difficult to follow. The paper would benefit from a more systematic definition of the notation and a clearer description of the role of each component.
-
Section 3.4 provides a relatively detailed description of how hard-negative samples are constructed, whereas the procedure for generating positive augmented representations is described only briefly in a single sentence. The augmentation procedure should be described in greater detail.
-
In the experimental section, the main reported results focus primarily on anomaly detection among the three downstream tasks considered in the paper. However, since the primary contribution of the paper is a general-purpose tabular representation learning framework, I believe that classification and regression results should receive greater emphasis in the main paper. At present, the experimental focus on anomaly detection baselines makes it difficult to fully evaluate the main representation learning contribution.
Questions for authors
-
In line 253, K-Means clustering is applied to {}, where the value of appears to range from 4 to 52 in the considered datasets. Please clarify how K-Means clustering is applied when the number of available vectors is quite small, and specify the value or selection procedure for the hyperparameter .
-
The loss function contains three hyperparameters, , , and . Please clarify the search spaces considered for these hyperparameters and report the values selected in the experiments. In addition, a sensitivity analysis would be useful for understanding how strongly the performance depends on these hyperparameters.
-
As I understand it, the final global representation does not directly appear in the main loss function in Equation (3). Please clarify how is trained and which objective explicitly extracts the final global representation.