Refine
Has Fulltext
- yes (3)
Is part of the Bibliography
- yes (3)
Year of publication
- 2022 (3) (remove)
Document Type
- Journal article (3)
Language
- English (3)
Keywords
- 3D-printed tooth (1)
- comparison (1)
- dental education (1)
- endodontics (1)
- extended matching questions (1)
- medical education (1)
- medical students (1)
- multiple choice questions (1)
- root-canal treatment (1)
- student performance (1)
Testing based on multiple choice questions (MCQ) is one of the most established forms of assessment, not only in the medical field. Extended matching questions (EMQ) represent a specific type of MCQ designed to require higher levels of cognition, such as problem-solving. The purpose of this evaluation was to assess the suitability and efficiency of EMQ as an assessment method. EMQ were incorporated into the end-of-semester examination in internal medicine, in which 154 students participated, and compared with three established MCQ types. Item and examination quality were investigated, as well as readability and processing time. EMQ were slightly more difficult to score; however, both item discrimination and discrimination index were higher when compared to other item types. EMQ were found to be significantly longer and required more processing time, but readability was improved. Students judged EMQ as clearly challenging, but attributed significantly higher clinical relevance when compared to established MCQ formats. Using the Spearman-Brown prediction, only ten EMQ items would be needed to reproduce the Cronbach’s alpha value of 0.75 attained for the overall examination. EMQ proved to be both efficient and suitable when assessing medical students, demonstrating powerful characteristics of reliability. Their expanded use in favor of common MCQ could save examination time without losing out on statistical quality.
Introduction
In endodontic education, there is a need for thorough training prior to students embarking on clinical treatment. The aim of this study was to use three-dimensional printing technology to create a new model and to compare its suitability for training purposes with resin blocks and extracted teeth.
Materials and Methods
Multi-jet-modelling (MJM) produced the 3D model replicating a common difficulty in root-canal morphology. An evaluation study comprising 88 students was run in the sixth semester (summer 2018 and winter 2018/2019). A new questionnaire assessed students’ perception of training models and educational environment. Welch's t-test analysed significant differences.
Results
The most pronounced differences between models were noted when rating material hardness, radiopacity, root-canal configuration and suitability for practising. Students estimated their learning outcome as greater with 3D-printed teeth compared to resin blocks. Three-dimensionally printed teeth received significantly lower ratings with regard to enthusiasm, the learning of fine motor skills and spatial awareness, when compared to human teeth (p ≤ .001). However, 3D-printed teeth were appreciated for additional benefits, such as their cleanliness, availability and standardisation of training opportunities with complex root-canal configurations.
Conclusion
Students preferred extracted human teeth to 3D-printed teeth with respect to their physical characteristics and training experience. However, educational advantages may compensate for the shortcomings. The new questionnaire proved both adequate and accurate to assess the models and educational environment in endodontic training. The new 3D-printed teeth enhanced the learning opportunities.
Background
Student performance is a mirror of teaching quality. The pre-/post-test design allows a pragmatic approach to comparing the effects of interventions. However, the calculation of current knowledge gain scores introduces varying degrees of distortion. Here we present a new metric employing a linear weighting coefficient to reduce skewness on outcome interpretation.
Methods
We compared and contrasted a number of common scores (raw and relative gain scores) with our new method on two datasets, one simulated and the other empirical from a previous intervention study (n = 180) employing a pre-/post-test design.
Results
The outcomes of the common scores were clearly different, demonstrating a significant dependency on pre-test scores. Only the new metric revealed a linear relationship to the knowledge baseline, was less skewed on the upper or lower extremes, and proved well suited to allow the calculation of negative learning gains. Employing the empirical dataset, the new method also confirmed the interaction effect of teaching formats with specific subgroups of learner characteristics.
Conclusion
This work introduces a new weighted metric enabling meaningful comparisons between interventions based on a linear transformation. This method will form the basis to intertwine the calculation of test performance closely with the outcome of learning as an important factor reflecting teaching quality and efficacy. Its regular use can improve the transparency of teaching activities and outcomes, contribute to forming rounded judgements of students' acquisition of knowledge and skills and enable valuable feedforward to develop and enhance curricular concepts.