Abstract While reading, the mind can wander to unrelated autobiographical information, creating a perceptually-decoupled state detrimental to narrative comprehension. To understand how this mind-wandering state emerges, we asked whether retrieving autobiographical content necessitates functional disengagement from visual input. In Experiment 1, brain activity was recorded using functional magnetic resonance imaging (fMRI) in an experimental situation mimicking naturally occurring mind-wandering, allowing us to precisely delineate neural regions involved in memory and reading. Individuals read expository texts and ignored personally relevant autobiographical memories, as well as the opposite situation. Medial regions of the default mode network (DMN) were recruited during memory retrieval. In contrast, left temporal and lateral prefrontal regions of the DMN, as well as ventral visual cortex, were recruited when reading for comprehension. Experiment 2 used functional connectivity at rest to establish that (i) DMN regions linked to memory are more functionally decoupled from regions of ventral visual cortex than regions in the same network engaged when reading, and (ii) individuals reporting more mind-wandering and worse comprehension, while reading in the lab, showed increased functional decoupling between visually-connected DMN sites important for reading and a region of dorsal occipital cortex linked to autobiographical memory in Experiment 1. These data suggest we lose track of the narrative when our mind wanders because the generation of autobiographical mental content relies on cortical regions within the DMN which are functionally decoupled from ventral visual regions engaged during reading. Significance statement When the mind wanders during reading, we lose track of information from the narrative. We hypothesised that poor comprehension occurs because retrieving autobiographical memories reduces the perceptual coupling necessary to understand written words. We show that default mode network (DMN) areas involved in reading are functionally more connected to ventral visual regions than DMN regions important for autobiographical memory. Furthermore, individuals who mind-wander more, and comprehend less, have weaker connectivity between visually-coupled DMN regions linked to reading and dorsal occipital areas linked to autobiographical memory. These data suggest that when our minds wander during reading, retrieval of personally-relevant information activates DMN regions that are functionally disconnected from visual input, creating a perceptually decoupled state detrimental to comprehension.