acceptodds
Under review as a conference paper at ICLR 2027

RePs: Learning Representations from Known Response Laws

Abstract

Existing augmentation-based self-supervised learning uses transformations to create new views, but often leaves their predictable effects on measurable signal properties unused. Our key insight is that when these effects follow known response laws, augmentation can generate not only new views but also new supervision: an existing measurement can be analytically transformed into the expected measurement of each augmented view. We introduce RePs (Response-law Privileged Supervision), which learns measurement-relevant representations by predicting these targets from augmented signals alone, without additional annotation. We test RePs across three distinct response structures and signal domains: temporal scaling in physiological signals, pitch translation in music, and spatial rotation in multichannel audio. RePs outperforms measurement-free baselines in frozen-feature response prediction across all three domains, reducing spatial angular error from to . With only 10% downstream labels, its ECG representation leads four released encoders on four of five clinical tasks. Controlled ablations further show that direct response supervision yields lower nonlinear readout error than separately predicting source measurements and transformations, supporting known response laws as a source of supervision for representation learning.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.