acceptodds
Under review as a conference paper at ICLR 2027

DynaLDI: Dynamic Latent State Estimation with Time-Varying Weak-Signal Reliability

Abstract

Longitudinal language analyses often aggregate heterogeneous weak signals, such as lexicon scores, sentiment measures, and neural classifier outputs, into a single temporal index despite changes in measurement quality and corpus composition. We introduce **DynaLDI**, a dynamic latent-index model that treats these signals as noisy measurements of a shared longitudinal state with autoregressive dynamics, source-specific nuisance effects, and reliability-conditioned time-varying measurement variance. On 480 held-out known-truth simulated longitudinal sequences spanning ten matched and misspecified regimes, the pre-specified DynaLDI configuration reduces latent-state RMSE by 24.0% relative to equal-weight standardized aggregation and by 7.0% relative to an earlier dynamic estimator, outperforming the latter in 91.9% of paired trials. It recovers source loadings with mean cosine similarity 0.999 and time-varying precision with correlation 0.985, while nominal 95% intervals attain 94.9% coverage under matched and near-matched conditions. Applied without retuning to 1.52 million *r/depression* submissions from 2009–2022, DynaLDI reduces several associations with observable corpus drift. Real-data perturbations reveal substantially greater sensitivity to measurement-model re-identification than to conditional state inference. A separate 384-sequence known-truth benchmark shows that the resulting composite sensitivity envelope improves severe-misspecification coverage from 71.6% to 84.4%, although its posterior-variance fraction is not a calibrated local reliability score. Prespecified ecological comparisons show selective temporal convergence with CDC depressive-symptom estimates, NSDUH adult major depressive episodes, and Google Trends searches, while U.S. suicide mortality remains negatively associated. The state-space computational kernel scales approximately linearly with sequence length. The Reddit trajectory is interpreted as a relative latent state of depression-related discourse measurements, not clinical prevalence, diagnosis, or individual risk.

Primary area:
learning on time series and dynamical systems
Keywords:
Mental Health NLP, State-space Models, Time Series Representation Learning, Latent Variable Model, Uncertainty Quantification, Multi-view Learning, Kalman Filtering

Reviews

Among:
Shape:
1234this paper, Bottom 10%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 1.67 over 3 reviews, above 10% of the others.
Reviewer_MR3oOpenReview ↗
Rating
2
Confidence
2
Informativeness
2
Presentation
3
Soundness
2
Read review
Paper summary

The authors introduced DynaLDI, a linear-Gaussian dynamic measurement model for estimating shared longitudinal state from multiple weak linguistic measurements. The model integrates Kalman filtering, dynamic factors, and heteroskedastic measurement models, and is validated via simulations and applications on external dataset.

Critical strengths

The paper addresses a real and important problem of how to estimate a shared longitudinal state from heterogeneous weak linguistic measurements, with rigorous validations.

Critical weaknesses

The model integrates various existing methods in longitudinal data analysis and signal processing. While this integration is reasonable, the authors do not clearly demonstrate that it provides new theoretical insights beyond existing approaches, which limits the novelty of this work.

The reliability of the stability diagnostics remains a concern. For example, only 4 of 8 prespecified diagnostic-performance criteria pass. The known-truth evaluation shows that 1−ρt1-\rho_t has median Spearman correlation of only 0.036 with absolute state error, and identification RMS only 0.068.

Questions for authors

Compared to existing state-space and dynamic factor models (or other models), what new theoretical or methodological insights does DynaLDI provide for longitudinal weak linguistic measurements?

1 comment
AuthorsOpenReview ↗

Response to Reviewer MR3o: Methodological Novelty and Diagnostic Reliability

We thank the reviewer for the valuable insights. We clarify both through additional matched experiments and explicit negative results.

Methodological contribution beyond existing models: DynaLDI combines (i) source-specific nuisance means, (ii) reliability-conditioned measurement variances with fixed, normalized loadings and (iii) an audit separating conditional state uncertainty from changes caused by re-estimating the measurement mapping. Fixed loadings constrain ambiguity between changing measurement precision and changing loading strength, without guaranteeing identification.

Precise inference conditional on fitted parameters need not be stable to changing measurement assumptions. In the Reddit audit, restricting the series to 2016 onward gives correlation 1.0001.000 with the reference under fixed parameters but 0.0010.001 after full refitting (Table 9). The audit operationalizes this distinction when no source is ground truth.

New matched ablations and independent baselines: In response to review, we evaluated 240 previously unused synthetic sequences (10 regimes ×\times 24 replicates) with the fixed estimator. The ablation RMSE progression is 0.63900.6390 (constant variance, no nuisance adjustment) →0.4859\rightarrow 0.4859 (+nuisance) →0.4653\rightarrow 0.4653 (+reliability conditioning) →0.4585\rightarrow 0.4585 (+robust inflation), a 28.2% aggregate reduction.

Paired incremental improvements and bootstrap 95% intervals are 0.15310.1531 [0.1164,0.1925][0.1164,0.1925], 0.02060.0206 [0.0173,0.0243][0.0173,0.0243] and 0.00680.0068 [0.0048,0.0089][0.0048,0.0089]. Nuisance adjustment gives the largest mean benefit but wins only 36.3% of pairs; the later components win 75.4% and 74.6%, and the full configuration wins 80.4% versus the unadjusted estimator. Thus the component gains are heterogeneous.

On the same datasets, DynaLDI (0.45850.4585 RMSE) is compared with independent statsmodels dynamic-factor fits (nuisance regressors, constant diagonal/full covariance), approximate Student-t IRLS/RTS and adaptive innovation-EWMA Kalman/RTS:

On the same 240 matched synthetic sequences, DynaLDI achieves lower aggregate RMSE than four independently fitted dynamic-factor, robust, and adaptive state-space comparators. These exploratory results support its empirical utility without establishing universal superiority. Section 5.1 and Appendix H of the revised manuscript provide the experimental details: Table 14 reports overall RMSE and convergence, Table 15 presents scenario-level results, and Table 16 provides paired improvements, 95% bootstrap confidence intervals, win counts, and optimizer-convergence sensitivity analyses.

Positive differences favor DynaLDI; intervals are conditional on the fixed scenario suite. Student-t is approximate, not exact likelihood optimization; adaptive noise uses a single pass followed by retrospective smoothing. All 240 finite DynaLDI fits are retained; excluding four optimizer-stopping failures preserves all four mean advantages (236 pairs). The full-covariance DFM wins under correlated noise (0.45420.4542 vs 0.59860.5986) and has near-zero state correlation under block missingness and combined stress despite convergence. Diagonal DFM wins under clean, nuisance-drift and correlated-noise conditions. These are additional exploratory results, separate from the original 480-sequence confirmatory benchmark, and do not imply universal superiority (Section 5.1; Appendix H, Tables 14--16).

Diagnostic reliability: After correcting the robust-inflated covariance used in fixed-parameter re-evaluation, the same independent 384-sequence benchmark still passes only 4/8 diagnostic criteria (4/4 integrity checks). Corrected median Spearman correlations with instantaneous absolute error are 0.03450.0345 for 1−ρt1-\rho_t and 0.06760.0676 for identification RMS, both below the predeclared 0.1500.150 threshold; posterior SD gives 0.1120.112. No criteria were changed.

Our additional aggregation analysis gives identification-RMS versus recovery-RMSE Spearman correlations of 0.4340.434 across datasets, 0.7590.759 across 16 scenario means and 0.2140.214 (median) within scenarios. Leave-one-scenario-out correlations are 0.732−0.8210.732 - 0.821, but six scenarios have negative within-scenario associations; posterior SD has median within-scenario correlation 0.6510.651. The full envelope increases severe-misspecification coverage from 0.71570.7157 to 0.84350.8435 and matched coverage from 0.93470.9347 to 0.98110.9811, indicating conservatism, not calibrated local confidence. These analyses use the same diagnostic benchmark, not new holdout data (Section 5.3; Appendix D, Tables 10 - 11).

The contribution is methodological and empirical: a weak-measurement specification and identification audit with evidence of where recovery improves and where assumptions and diagnostics fail.

Reviewer_pZkkOpenReview ↗
Rating
1
Confidence
2
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

This paper describes an approach, Dynamic Latent State Estimation with Time-Varying Weak-Signal Reliability (DynaLDI), that treats heterogeneous weak signals (e.g., lexicon scores, sentiment measures, or neural classifier outputs) as noisy measurements of a shared longitudinal state. Key contributions include the DynaLDI linear-Gaussian dynamic measurement model itself, as well as perturbation-based identification and support diagnostics to help disentangle the distinction between conditional state uncertainty and measurement-model identification stability. The contributions are evaluated using both simulated longitudinal sequences and longitudinal submissions to r/depression using a variety of performance measures.

Critical strengths

The paper has a nice problem statement that's relatively straightforward to test. The approach also seems sound for the most part, albeit a bit oddly described in places (it often calls out its own limitations!). The evaluation is also quite comprehensive---I'd say bordering a bit on too comprehensive (it at times feels sort of like throwing the kitchen sink at model), but it gives many perspectives by which to view performance.

Critical weaknesses

The paper was relatively difficult to read---not because of grammatical issues per se, but because the descriptions were very jargon-dense without always really seeming to flow easily from one paragraph to another. It'd also be helpful to support some of the statements with relevant literature. This was especially the case in the introduction; for instance, the first paragraph makes lots of broad statements, but doesn't really back them up with evidence.

The paper's choice of focusing on r/depression data (and it seems like perhaps a particular focus on suicidality?) was also confusing and not really explained. It'd be beneficial to have some clearer motivation of why this clinically important and very sensitive domain was selected without seemingly having much attachment to the problem itself (e.g., no mention of clinical collaborators or background relevant to the task domain, or clear reasons why this domain was chosen as opposed to any potential other longitudinal data domains). It'd also be good to clarify whether ethics approval, for example through an IRB, was obtained prior to the work, since it's generally needed for this type of data.

The related work section was fine, but didn't really cover any recent work (the most recent papers were from 2019). It'd be interesting to see if there's been more contemporary related work in this area as well, even if not pursuing the exact same problem.

The evaluation was extensive, but could be more effectively motivated---for instance, it'd be helpful to know why the four data families were selected for the ecological alignment measure (were these four used in relevant prior work?) and why the various metrics were chosen. It might also be useful to map them specifically back to the original problem statement, and metrics that weren't relevant to testing the hypothesis itself could be described in the appendix to help simplify the paper.

Questions for authors
  • This doesn't really materially affect my judgement, but what does "Each sequence has 5,113 time points, matching the Reddit calendar" in Section 4.2 mean? I guess maybe that simulated data covered one data point for every day from January 1, 2009 to December 2022? The reasoning behind a lot of Section 4.2 was a little unclear to me---for example, I also didn't fully understand how the 16 unseen scenarios (not overlapping at all with the other 10 held-out scenario conditions?) fit into the picture.
1 comment
AuthorsOpenReview ↗

Response to Reviewer pZkk: Motivation, Research Context and Experimental Design

We thank the reviewer for the constructive feedback. We revised Sections 1 - 4 and 6 for clarity and added supporting analyses.

Clarity and motivation: The Introduction section now motivates the limitations of fixed aggregation under changing nuisance effects and measurement reliability, then separates the estimand, inference, identification audit and evaluation objectives. We have added literature support and moved technical details to the appendix.

Dataset choice, domain expertise and ethics: We selected r/depression as a demanding longitudinal measurement setting, not a clinically diagnosed population. Its fourteen-year corpus (1,516,4421,516,442 submissions, 499,067499,067 authors) exhibits changing participation, volume, text availability and moderation, directly motivating nuisance/reliability modeling (Section 4.1). The Depression - Suicidality Contrast classifier uses subreddit labels from SDCNL, not clinical assessments, and its output is one of five weak measurements, not a depression probability or suicide-risk score. Our study concerns statistical measurement; clinical or public-health applications require independent clinical validation and domain expertise, outside its scope.

We recognize the sensitivity of these disclosures. We use archived posts, aggregate post-level scores daily, do not recruit/contact or profile users, reproduce no post text or identifiers, and do not reconstruct removed/deleted bodies. The Ethics Statement and Appendix G exclude diagnosis, individual screening and prevalence inference.

Recent literature: Sections 1 - 2 now discuss TimeLMs (Loureiro et al., 2022), temporal generalization in social media (Ushio and Camacho-Collados, 2024), time-aware mood-change modeling (Hills et al., 2024) and robust aggregated mental-health language measurements (Mangalik et al., 2024). Unlike individual classification or mood-transition detection, we estimate and audit a shared weak-measurement trajectory.

External data and evaluation objectives: CDC HPS and NSDUH measure depressive symptoms and major depressive episodes, Google Trends captures search behavior (Worldwide/U.S.), and NVSS suicide mortality probes an interpretation boundary. Mangalik et al. motivate language-survey comparisons, but our four-family/five-series design is not an established standardized benchmark. None of these targets is used for fitting/retuning or treated as ground truth. Population, geography and timescale mismatches are acknowledged.

Known-truth RMSE correlation assess recovery; coverage and loading/precision metrics assess uncertainty and measurement structure; diagnostic tests assess error ranking and envelope coverage. For ecological comparisons, Pearson/Spearman describe linear/monotonic association, zRMSE is an algebraically related distance representation of Pearson for independently standardized aligned series (not independent evidence), and directional agreement describes successive changes. Block bootstrapping addresses temporal dependence; detrending, differencing and year omission probe robustness.

Additional analyses show Worldwide Google Trends Pearson 0.3330.333 at lag zero, 0.3860.386 detrended, 0.3600.360 first-differenced, and [0.270,0.400][0.270,0.400] across year omissions. U.S. Trends remains positive under these transformations. CDC decreases from 0.3180.318 to 0.0680.068 without 2021 and its bootstrap intervals include zero. NSDUH changes from 0.2300.230 to −0.031-0.031 detrended and −0.328-0.328 first-differenced. NVSS changes from −0.249-0.249 to 0.3910.391 after detrending. These findings support selective ecological correspondence, not clinical validation (Sections 4.3, 5.4; Appendix E).

Q: 5,113 time points and 16 scenarios: Yes: 5,1135,113 is the inclusive daily calendar, Jan. 1, 2009 - Dec. 31, 2022 (including three leap days). Numerical simulations match its length and five channels, not historical Reddit text. The 480-sequence recovery benchmark (10×4810\times48; IDs 48 - 95) evaluates state recovery. The independent 384-sequence diagnostic benchmark (16×2416\times24; IDs 120 - 143) reuses ten stress categories, not sequences, and adds six identification stresses: weak factor, dual factor, loading rotation, reliability - state confounding, removal-process shift and dominant-source variance collapse. The added exploratory ablation/baseline evaluation uses 240 separate sequences (IDs 300 - 323). Section 4.2 and Appendices B, D and H now distinguish their objectives and designs.

Reviewer_Sb3eOpenReview ↗
Rating
2
Confidence
2
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

This paper introduces DynaLDI, an approach for estimating dynamic latent state in scenarios where the reliability of weak signals varies over time. The authors show the effectiveness of this method through simulations, and do a case study on depression-related discourse on Reddit.

Critical strengths

The paper is generally clear. I'm not an expert in this field, but the paper seems to propose a useful approach to estimate the latent state. The paper also provides a detailed case study on depression-related Reddit discourse, including sensitivity analyses and comparisons with external indicators.

Critical weaknesses

My major concern is the novelty of this paper. The proposed method seems to be a combination of existing methods, and it's not clear to me whether the contribution is substantial.

Questions for authors
  1. In the Reddit experiment, you interpret the latent state as a depression-related discourse measurement, and support this interpretation through correlations with external indicators. However, if such external indicators are unavailable, how can the interpretation of the latent state be assessed? What practical analyses or conclusions can this index support in that case?
  2. Can you provide an explicit mathematical definition of each four term in eq(5)? As a reader not familiar with this area, I will find this helpful to understand what each term measures.
  3. The text in Figure 1 is too small to read. Please increase the font size for better readability.
1 comment
AuthorsOpenReview ↗

Response to Reviewer Sb3e: Methodological Contribution and Latent-State Interpretation

We thank the reviewer for recognizing the potential usefulness of DynaLDI. We revised Sections 1--3 and 5, and added controlled experiments to clarify its contribution and interpretation.

Novelty: Our contribution is a constrained longitudinal weak-measurement formulation combining source-specific nuisance effects, reliability-conditioned precision and fixed loadings, together with an audit distinguishing conditional state uncertainty from sensitivity to re-estimating the measurement mapping.

We evaluated 240 additional matched synthetic sequences across ten regimes. Mean standardized latent-state RMSE decreases from 0.63900.6390 (constant variance, no nuisance adjustment) to 0.48590.4859 (+nuisance adjustment), 0.46530.4653 (+reliability conditioning) and 0.45850.4585 (+robust covariance inflation). The incremental paired mean improvements are 0.15310.1531, 0.02060.0206 and 0.00680.0068, respectively. DynaLDI also achieves lower mean RMSE than independently fitted diagonal/full-covariance dynamic-factor models (0.50100.5010/0.61370.6137) and approximate Student-t/adaptive Kalman-RTS estimators (0.53360.5336/0.55260.5526). These exploratory results support the formulation's empirical utility, not a new state-space model class or universal superiority (Section 5.1; Appendix H).

Q1. Interpretation without external indicators: Without external anchors, the state describes relative temporal variation jointly supported by the specified linguistic measurements, conditional on the fitted model and its sign/scale conventions. It supports (i) descriptive temporal comparisons, (ii) analysis of changing source-information shares, and (iii) sensitivity analysis under source removal, observation-support changes and full refitting. For example, starting the Reddit analysis in 2016 gives correlation 1.0001.000 with the reference under fixed parameters but only 0.0010.001 after full refitting (Table 9). This distinction helps identify when an apparent trajectory is dependent on the measurement specification.

We also added retrospective masked-measurement reconstruction (Appendix A.2): all five channels are withheld simultaneously in four 90-day blocks, with corpus covariates retained and models refitted outside each block. Across 20 source--block evaluations, mean RMSE is 0.18040.1804 for DynaLDI, 0.18180.1818 without robust inflation, 0.18960.1896 with nuisance-adjusted constant variance and 0.22650.2265 for linear interpolation. This assesses reconstruction of observable measurements using surrounding observations, not prospective forecasting or clinical latent-state recovery. External robustness analyses likewise show selective ecological correspondence rather than clinical validity (Section 5.4; Appendix E). Without independent clinical anchors, neither diagnosis, prevalence nor individual risk can be inferred.

Q2. Definitions of Eq.~(5): Section 3.3 now explicitly defines the four components. Let d^t\hat d_t be the reference RTS-smoothed state and Pt∣TP_{t|T} its conditional posterior variance. For family ff and protocol a∈{refit,fixed}a\in\{\mathrm{refit},\mathrm{fixed}\}, define

\frac{1}{|K_{f,t}^{(a)}|} \sum_{k\in K_{f,t}^{(a)}} \left(\hat d_{f,k,t}^{(a)}-\hat d_t\right)^2,$$ where $K_{f,t}^{(a)}$ indexes available sign-and-scale-aligned perturbation trajectories. The four equally weighted families $\mathcal F$ are source removal, nuisance changes, quality restrictions and temporal-support changes. $$V_t^{\mathrm{post}} = P_{t|T}$$ $$V_t^{\mathrm{id}} = |\mathcal F|^{-1} \sum_{f\in\mathcal F}D_{f,t}^{(\mathrm{refit})}$$ $$V_t^{\mathrm{support}} = |\mathcal F|^{-1} \sum_{f\in\mathcal F}D_{f,t}^{(\mathrm{fixed})}$$ $$V_t^{\mathrm{block}} = Var_b\left(\hat d_{b,t}^{\mathrm{block}}\right)$$ These quantify conditional uncertainty, full-refit sensitivity, fixed-parameter support sensitivity and variability across random contiguous-block deletion trajectories, respectively. Their sum (*Eq. 6*) is a composite sensitivity measure; the terms need not be independent. It is not an orthogonal error decomposition or a calibrated posterior/confidence interval. **Q3. Figure 1:** We enlarged the vector schematic in the revised manuscript, retaining the separation of measurements, latent dynamics, reliability conditions and state inference. The mathematical definitions are provided separately in *Section 3*. We appreciate the reviewer's suggestions, which helped us clarify the methodological contribution and the practical and interpretive boundaries of the index.

Comments on the paper

1 comment
AuthorsOpenReview ↗

Summary of Manuscript Revisions and Additional Experiments

We thank the reviewers for their constructive feedback. We have revised the manuscript to clarify the methodological contribution, improve the motivation and presentation, and strengthen the experimental evidence.

The revised manuscript includes the following additions:

Component ablations: A new matched 240-sequence synthetic evaluation isolates the contributions of nuisance adjustment, reliability-conditioned measurement variance, and robust covariance inflation.

Independent baseline comparisons: On the same 240 sequences, we compare DynaLDI against independently fitted diagonal and full-covariance dynamic-factor models and approximate robust and adaptive state estimators. We report paired performance, uncertainty, convergence limitations, and conditions favoring conventional baselines.

Diagnostic-validation analysis: Additional analyses examine identification sensitivity at dataset, scenario, and within-scenario scales. The original four-of-eight diagnostic-performance outcome remains unchanged, and the revised manuscript clarifies the limits of local error interpretation.

Ecological robustness: We extend the original external comparisons using detrending, first differencing, and calendar-year omission. These analyses identify both persistent temporal associations and relationships sensitive to trend treatment.

Presentation and methodology: We clarify the latent-state estimand, expand the stability-component definitions, strengthen the recent literature review and dataset motivation, and revise the discussion of limitations.

The original pre-specified experiments remain distinct from the additional exploratory evaluations. Detailed methods, numerical comparisons, and negative results are included in the revised appendix.

These changes address the reviewers' methodological and interpretive concerns without claiming a new theoretical guarantee or independent clinical validation. The revised PDF and its comparison with the original submission make the modifications identifiable.

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.