According to the tripartite model of text representation (van Dijk & Kintsch, 1983), readers form representations of the text surface and textbase, and construct a situation model. In this study, an experiment was conducted to investigate whether these levels of representation would be affected by adding illustrations to narrative text and whether the order of text and illustrations would make a difference. Students aged between 7 and 13 years (N = 146) read 12 narrative texts, 4 of them with illustrations presented before their corresponding sentences, 4 with illustrations presented after, and 4 without any illustration. A sentence recognition task was used to assess the accuracy for text surface, textbase, and situation model. For the text surface and situation model, neither the presence of illustrations nor the order of text and illustrations influenced accuracy. However, the textbase was negatively affected by illustrations when they followed their corresponding sentences. We suggest that illustrations can initiate model inspection after situation model construction (Schnotz, 2014), a process that can make substantial changes to the textbase representation.

In three studies, we investigated, if and how different modes of presentation - written, auditory, audiovisual (auditory combined with pictures) - affect comprehension of semantically identical materials. Children, beginning from the age of 7, and adults were included into the studies. A vast amount of studies have shown that pictures can facilitate text comprehension (e.g. Carney & Levin, 2002). Other than the majority of these previous studies, we assessed text comprehension with methods that we assume to allow more differentiated insights into the cognitive processes that - according to current theories - underlie text comprehension. Text comprehension involves at least three levels of mental representations (see Kintsch, 1998). Moreover, text comprehension means constructing a locally and globally coherent mental representation of the text content. Using a sentence recognition task (see Schmalhofer & Glavanov, 1986), we examined whether the memory of the text surface, the text base, and the situation model differs between written, auditory, and audiovisual text presentation in a sample of 103 8- and 10-year-olds and adults (Study I), and between auditory and audiovisual text presentation in a sample of 106 7-, 9-, and 11-year-olds (Study II). Furthermore, we examined with 155 9- and 11-year-olds, whether the ability to draw inferences to establish local and global coherence differs between written, auditory, and audiovisual text presentation. These inferences were indicated by reaction times to words associated with a protagonist's super- (global) or subordinate (local) goal. Overall, the results of these three studies taken together, indicate that children up to age 11 do not only have better memory of not only the text surface, but also of the situation model when pictures are added to an auditory text. This effect became apparent in comparison with both auditory and written texts. For the adults, in contrast, we did not find an effect of the presentation mode. Furthermore, both 9- and 11-year-olds were better at establishing global coherence at audiovisual compared to auditory text presentation. Written presentation turned out to be superior to auditory presentation in terms of both local and global coherence.