acceptodds
Under review as a conference paper at ICLR 2027

The Learning Geometry of Deterministic Views

Abstract

Adding deterministic views of an observation can change a model's predictions without adding information. This makes a standard view ablation difficult to interpret: the input expansion may also change the learning rule. We characterize this intervention for full-rank fixed linear views, each embedded by a trainable linear branch and summed before a shared receiver. Their frame operator preconditions the effective SGD update and determines the norm induced by branch regularization. Two view systems produce the same update for every loss exactly when their frame operators agree. With matched initialization, equal- systems follow identical trajectories under SGD and scalar-linear optimizer state, including momentum. The classical Parseval transform therefore supplies a neutral control relative to the parent-only model. Nonidentical equal- frames match exactly in our experiments, whereas equal-trace frames can separate. One multiscale frame changes subject-mean NLL by on Sleep-EDF and on ISRUC; Parsevalization removes both differences. Independent schedule selection retains a Sleep-EDF gap of (95% CI ). AdamW and branchwise nonlinearities break the tested equivalences. The frame operator thus specifies what to control when attributing a deterministic view's effect to the representation.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.