- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper attempts to tackle feature compilation problem from a functional dependency perspective. Specifically, the paper identifies an edge cases where Deep Feature Synthesis is invariant to label-relevant signals, and demonstrates that the functional dependency is the key to solve this problem. Such a motivation is valid and has been brought up by recent literature. However, the proposed method doesn’t seem to tackle that problem from my understanding. Specifically, the proposed method still aggregates summary statistics for training rows by going over every single pair of columns, filter them, and construct a lookup table for the compiled feature. However, during inference, for two different histories with the same key to be looked up, they will still end up with the same compiled features, which contradicts with the edge case proposed in the motivation section.
Critical strengths
The strength of the paper is explicit modeling the functional dependency of columns in a table, which seems novel compared to recent literature. However, it doesn’t mean the idea is sounded; modeling pairwise dependency is costly to scale (see Weaknesses). While the paper is supported with an ample amount of experiments, I have concerns regarding validity of the experiments. For these reasons, I believe that the paper lacks of substantive strength to be accepted.
Critical weaknesses
The major problem of the paper is clarity, motivation, and unclear experiments. Below are some key points:
- The paper has problems with clarity, where non-canonical terms are randomly introduced without clarifications. Some examples include, but not limited to, determinant-dependent structure and independent selection. Some terms are prematurely introduced without any contexts such as functional-dependency hypergraph, thus leading to weak clarity.
- Figure 1 represents a failure of column-wise aggregation, which has been previously demonstrated in KumoRFM-2 paper [1]. It is the same concept presented in Figure 1. The authors failed to acknowledge the overlap between the proposed approach and KumoRFM-2 in achieving separation of these edge cases.
- The paper failed to introduce the motivation of the expanding temporal folds, and which cutoff times are chosen for these folds.
- The proposed method only works with categorical features or numerical features with small unique numbers due to the 5 statistics.
- The usage of the word hypergraph is misleading since the paper only attempts to model dependency between 2 columns, which should just be a pairwise dependency.
- The method fails to tell apart the two histories presented in Figure 1 since the the 5 statistics are order-agnostic and computed based on the past records in the table. In other word, during inference, if two different history sequences are presented, the proposed approach won’t be able to tell them apart either since they just retrieve the computed metrics from the look-up table.
- The number of dependency scales with the square of number of columns in a table, which means the model is far from scalable.
- Why does Table 1 have JUICE implemented differently from the version report in its official paper (which causes suspiciously lower performance)?
[1] Hudovernik et al. KumoRFM-2: Scaling Foundation Models for Relational Learning. 2026.
Questions for authors
- Appendix A.1. is poorly written with unclear experiment details. Could the authors elaborate more the experiment settings in this section?
- Appendix A.2. looks confusing. If I understand correctly, we’re having features constructed for badges computed already. The paper attempts to shuffle names, which shouldn’t change the summary statistics that are constructed for badges either. In other words, the proposed method should yield the same result with DFS, but the paper states that the proposed method can yield positive FDHG distance. How is it possible? Also this question shares the same concern with Weakness 6.
- What are the motivations for picking the 5 summary statistics?