Refine
Has Fulltext
- yes (2)
Is part of the Bibliography
- yes (2)
Document Type
- Doctoral Thesis (2)
Language
- English (2) (remove)
Keywords
- Textverstehen (2) (remove)
Institute
Sonstige beteiligte Institutionen
- BMBF (1)
The abilities to comprehend and critically evaluate scientific texts and the various arguments stated in these texts are an important aspect of scientific literacy, but these competences are usually not formally taught to students. Previous research indicates that, although undergraduate students evaluate the claims and evidence they find in scientific
documents to some extent, these evaluations usually fail to meet normative standards. In addition, students’ use of source information for evaluation is often insufficient. The rise of the internet and the increased accessibility of information have yielded some additional challenges that highlight the importance of adequate training and instruction.The aim of the present work was to further examine introductory students’ competences to systematically and heuristically evaluate scientific information, to identify relevant strategies that are involved in a successful evaluation, and to use this knowledge to design appropriate interventions for fostering epistemic competences in university students.To this end, a number of computer-based studies, including both quantitative and qualitative data as well as experimental designs, were developed. The first two studies were designed to specify educational needs and to reveal helpful processing strategies that are required in different tasks and situations. Two expert-novice comparisons were developed, whereby the performance of German students of psychology (novices) was compared to the performance of scientists from the domain of psychology (experts) in a number of different tasks, such as systematic plausibility evaluations of informal arguments (Study 1) or heuristic evaluations of the credibility of multiple scientific documents (Study 2). A think-aloud procedure was used
to identify specific strategies that were applied in both groups during task completion, and that possibly mediated performance differences between students and scientists. In addition, relationships between different strategies and between strategy use and relevant conceptual knowledge was examined. Based on the results of the expert-novice comparisons, an intervention study, consisting of two training experiments, was constructed to foster some
competences that proved to be particularly deficient in the comparisons (Study 3). Study 1 examined introductory students’ abilities to accurately judge the plausibility of informal arguments according to normative standards, to recognise common argumentation fallacies, and to identify different structural components of arguments. The results from Study 1 indicate that many students, compared to scientists, lack relevant knowledge about the structure of arguments, and that normatively accurate evaluations of their plausibility seem to be challenging in this group. Often, common argumentation fallacies were not identified correctly. Importantly, these deficits were partly mediated by differences in strategy use: It was especially difficult for students to pay sufficient attention to the relationship between argument components when forming their judgements. Moreover, they frequently relied on their intuition or opinion as a criterion for evaluation, whereas scientists predominantly determined quality of arguments based on their internal consistency.
In addition to students’ evaluation of the plausibility of informal arguments, Study 2 examined introductory students’ competences to evaluate the credibility of multiple scientific texts, and to use source characteristics for evaluation. The results show that students struggled not only to judge the plausibility of arguments correctly, but also to heuristically judge the credibility of science texts, and these deficits were fully mediated by their insufficient use of source information. In contrast, scientists were able to apply different strategies in a flexible manner. When the conditions for evaluation did not allow systematic processing (i.e. time limit), they primarily used source characteristics for their evaluations. However, when
systematic evaluations were possible (i.e. no time limit), they used more sophisticated normative criteria for their evaluations, such as paying attention to the internal consistency of arguments (cf. Study 1). Results also showed that students, in contrast to experts, lacked relevant knowledge about different publication types, and this was related to their ability to correctly determine document credibility. The results from the expert-novice comparisons also suggest that the competences assessed in both tasks might develop as a result of a more fundamental form of scientific literacy and discipline expertise. Performances in all tasks were positively related. On the basis of these results, two training experiments were developed that aimed at fostering university students’ competences to understand and evaluate informal arguments (Study 3). Experiment 1 describes an intervention approach in which students were familiarised with the formal structure of arguments based on Toulmin’s (1958) argumentation model. The performance of the experimental group to identify the structural components of this model was compared to the performance of a control group in which speed reading skills were practiced, using a pre-post-follow-up design. Results show that the training was successful for improving the comprehension of more complex arguments and relational aspects between key components in the posttest, compared to the control group. Moreover, an interaction effect was found with study performance. High achieving students with above average grades profited the most from the training intervention. Experiment 2 showed that
training in plausibility, normative criteria of argument evaluation, and argumentation fallacies improved students’ abilities to evaluate the plausibility of arguments and, in addition, their competences to recognise structural components of arguments, compared to a speed-reading control group. These results have important implications for education and practice, which will be discussed in detail in this dissertation.
Reading skills are among the most important basic skills in society. However, not all readers are able to adequately understand texts or decode individual words. Findings from the Progress in International Reading Literacy Study (PIRLS; German: IGLU) show that about one fifth of fourth graders can only establish coherence at the local level, and in some cases they only have a rudimentary understanding of the text they read (Bremerich-Vos et al., 2017). In addition, these reading deficits persist and have a negative impact on academic and professional success (Jimerson, 1999). Therefore, identifying the causes of these deficits and creating opportunities for interventions at an early stage is an important research objective.
The aim of this dissertation was to examine the relationship between the aspects of reading fluency and their influence on reading comprehension. Despite the increasing scientific interest in reading fluency in recent years, a research gap still exists in the relationship between word recognition accuracy and both speed and the relevance of prosodic patterns for reading comprehension.
Study 1 investigated whether German fourth graders (N = 826) were required to reach a certain word-recognition accuracy threshold before their word-recognition speed improved. In addition, a sub-sample (n = 170) with a pre-/posttest design was examined to assess the extent that the existing word-recognition accuracy can influence the effects of a syllable-based reading intervention on word-recognition accuracy and word-recognition speed. Results showed that word-recognition speed improved after children achieved a word-recognition accuracy of 71%. A positive intervention effect was also found on word-recognition accuracy for children who were below the 71% threshold before the intervention, whereas the intervention effect on word-recognition speed was positive for all children. However, a positive effect on reading comprehension was only found for children who were above the 71% threshold before the intervention.
Study 2 investigated the relationship between word-recognition accuracy threshold and word-recognition speed shown in the first study in a longitudinal design with German students (N = 1,095). Word-recognition accuracy and speed were assessed from the end of Grade 1 to 4, whereas reading comprehension was assessed from the end of Grade 2 to 4. The results showed that the developmental trajectories of word recognition speed and reading comprehension were steeper in children who reached the word-recognition accuracy threshold by the end of the first grade than in children who later reached or had not reached this threshold.
In Study 3, recurrence analysis (RQA) was used to extract prosodic patterns from reading recordings of struggling and skilled readers in the second (n = 67) and fourth grade (n = 69) and was used for the classification into struggling and skilled readers. In addition, the classification based on the prosodic patterns from the recurrence quantification analysis was compared with the classification of prosodic features from the manual transcription of the reading recordings. The results showed that second-grade struggling readers have lengthier pauses within or between words and take more time between pauses on average, whereas fourth-grade struggling readers spend more time between recurring stresses and have multiple diverse patterns in pitch and more recurring accents. Although the recurrence analysis had a good goodness of fit and provided additional information about the relationship of prosody with reading comprehension, the model using prosodic features from transcription had a better fit.
In summary, the three studies in this dissertation provide four important insights into reading fluency in German. First, a threshold in word-recognition accuracy must be achieved before word-recognition speed improves. Second, the earlier this accuracy level is reached, the greater the gain in word-recognition speed and reading comprehension. Third, the intervention effects of a primary school reading intervention are influenced by the accuracy level. Fourth, although incorrect pauses within or between words play an important role in identifying and describing struggling readers in second grade, the importance of prosodic patterns increases in fourth grade.