- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper presents BTS-Flow, which treats asynchronous multimodal inputs as observations of a shared latent process. A neural ODE propagates the state between observations, and modality-specific prediction guides state updates. An additional loss aligns acoustic and visual derivatives to changes induced by the latent dynamics. Experiments are conducted in five related benchmarks.
Critical strengths
The separation of latent evolution from observation is well motivated for asynchronous multimodal inputs. Modality-specific observation functions and event-based language updates provide a coherent implementation without requiring identical representation spaces.
Critical weaknesses
The contribution over established continuous-time estimators is not fully isolated. Since [1,2] already combine continuous propagation between observations with updates when observations arrive, what the heterogeneous observation functions and first-order supervision add to this established structure? Removing first-order supervision reduces Acc-2 by 0.3/0.4 points and increases MAE by 0.005 on MOSI/CH-SIMS-v2. Figure 5 shows larger improvements in velocity consistency, which supports the intended regularization effect, but the reliability of the downstream gains and their contribution beyond the existing estimation framework remain unclear. The experiments support predictive ability and robustness to synthetic sampling changes more than task dynamics.
[1] Latent ordinary differential equations for irregularly-sampled time series. NeurIPS 2019.
[2] GRU-ODE-Bayes: Continuous Modeling of Sporadically-Observed Time Series. NeurIPS 2019.
Questions for authors
Are the observation encoders, derivative targets, and evaluation decoders fixed and shared across methods when computing CQE and velocity consistency? If learned separately, what ensures that lower prediction errors reflect better dynamics rather than easier prediction targets?
Does the performance gains persist when observation updates and auxiliary losses are equipped to an established model?
Dear Reviewer K73h,
Thank you again for your thoughtful feedback!
As the rebuttal period is coming to an end, we would like to gently follow up on our response. We hope our clarifications have addressed your concerns, and we would greatly appreciate any further feedback you might have.
Please feel free to let us know if there are any remaining questions or concerns. We would be happy to clarify further.
Thank you for your time and consideration!
Best regards,
The Authors