Epistemic Goggle is a quite recent method that was built to train models into believing that a span of text is e.g. fictional. Motivated by phenomena like negation neglect, where ordinary training tends to ignore labels such as "this is false" or "this is fiction" when they appear in the training data, Goggles allow to "mark" entire spans of text as e.g. fiction during training. This paper is a sequel or an analysis of Goggles that wonders what happens to real facts that are related to the fictional story, if they are learned at the same time.
In particular, it trains a small LLM on pairs of events about the same person: one real, and one fictional, opposing a Goggles run to a classic training run (A Goggle run uses Goggle editing only for the fictional story, but ordinary training for the real one). It finds that unlike ordinary training which gets it right, the real fact is labeled fiction by the Goggle trained model, even though Goggles never touched it. The paper further reports that even after ordinary training, whether a model will consider an event as real depends on the way the question is asked. General, this work motivates the fact that a method that wants to label a span as fictional, must also be tested on whether related real facts keep their "real" status.