- Research article
- Open Access
- Open Peer Review
How can we teach medical students to choose wisely? A randomised controlled cross-over study of video- versus text-based case scenarios
© The Author(s). 2018
- Received: 11 December 2017
- Accepted: 4 June 2018
- Published: 6 July 2018
The Choosing Wisely campaign highlights the importance of clinical reasoning abilities for competent and reflective physicians. The principles of this campaign should be addressed in undergraduate medical education. Recent research suggests that answering questions on important steps in patient management promotes knowledge retention. It is less clear whether increasing the authenticity of educational material by the inclusion of videos further enhances learning outcome.
In a prospective randomised controlled cross-over study, we assessed whether repeated video-based testing is more effective than repeated text-based testing in training students to choose appropriate diagnostic tests, arrive at correct diagnoses and identify advisable therapies. Following an entry exam, fourth-year undergraduate medical students attended 10 weekly computer-based seminars during which they studied patient case histories. Each case contained five key feature questions (items) on the diagnosis and treatment of the presented patient. Students were randomly allocated to read text cases (control condition) or watch videos (intervention), and assignment to either text or video was switched between groups every week. Using a within-subjects design, student performance on video-based and text-based items was assessed 13 weeks (exit exam) and 9 months (retention test) after the first day of term. The primary outcome was the within-subject difference in performance on video-based and text-based items in the exit exam.
Of 125 eligible students, 93 provided data for all three exams (response rate 74.4%). Percent scores were significantly higher for video-based than for text-based items in the exit exam (76.2 ± 19.4% vs. 72.4 ± 19.1%, p = 0.026) but not the retention test (69.2 ± 20.2% vs. 66.4 ± 20.3%, p = 0.108). An additional Bayesian analysis of this retention test suggested that video-based training is marginally more effective than text-based training in the long term (Bayes factor 2.36). Regardless of presentation format, student responses revealed a high prevalence of erroneous beliefs that, if applied to the clinical context, could place patients at risk.
Repeated video-based key feature testing produces superior short-term learning outcome compared to text-based testing. Given the high prevalence of misconceptions, efforts to improve clinical reasoning training in medical education are warranted. The Choosing Wisely campaign lends itself to being part of this process.
- Medical education
- Clinical reasoning
- Choosing wisely
- Test-enhanced learning
One of the most important aims of undergraduate medical education is to enable future physicians to arrive at correct diagnoses and treatment recommendations based on the results of appropriate diagnostic tests. Making correct decisions is at least as important as avoiding unnecessary tests and incorrect diagnoses, and both need to be considered in the context of clinical reasoning . Recently, the Choosing Wisely campaign has added another important feature to the professional approach to patient management [2, 3]. In order to avoid unnecessary or potentially harmful diagnostic and therapeutic procedures, recommendations compiled by medical societies in various countries across the globe  advise a more thorough consideration of the specific merits and limitations of these interventions and discourage the use of some in specific circumstances [5, 6]. Clinical reasoning abilities are a prerequisite for making ‘wise choices’ in clinical medicine, thus suggesting that teaching interventions aimed at fostering clinical reasoning may also enhance performance with regard to the recommendations derived from the Choosing Wisely campaign. Vice versa, these recommendations result from a stringent application of the principles of clinical reasoning. Thus, the choice of teaching formats that lend themselves to the discussion of these recommendations should be guided by a discussion of instructional formats used to address clinical reasoning itself. One effective approach to enhancing the complex cognitive functions related to clinical reasoning is case-based learning , which is traditionally facilitated in small groups  or at the bedside . Given the limitations of these formats regarding resource intensity and availability of patients with rare but important diseases, computer-assisted case-based learning with virtual patients  has been proposed as a viable approach to teaching clinical reasoning [11, 12].
Digital interventions in medical education need to be informed by educational and psychological research. One recent example of this type of ‘translational research’ in medical education is the growing body of evidence showing that test-enhanced learning enhances knowledge and skills retention in undergraduate medical students. The basic idea is that questions can be used to stimulate learning processes [13, 14]. Thus far, a number of studies have shown that tests can in fact be used as learning tools in medical education . For example, in one study involving 47 first-year medical students, repeated testing of factual knowledge in neurology elicited greater long-term retention than repeated study of the same material . Another randomised study yielded a similar effect for the retention of practical (resuscitation) skills . However, none of these studies focussed on clinical reasoning. One potential reason for this is that rote memory can easily be tested using multiple choice questions while testing clinical reasoning is more complex. One test format suited for this purpose is the so-called key feature question. A key feature is defined as a significant step in patient management. Key feature questions were designed to test the knowledge needed to avoid common errors occurring at these decisive points. For example, the key features in one of the cases used in this study referred to the management of a potentially life-threatening condition. First, students were prompted to provide the most likely diagnosis (key feature 1: pulmonary embolism) for a 44-year-old female patient who had been immobilised with lumbago for a week and who experienced sudden chest pain and shortness of breath following defaecation. In the second question, students were expected to identify calculation of the Wells Score as the next key feature in patient management. Following this, students were informed that this score was 6, and they were asked to name the most appropriate next step for the patient who was haemodynamically stable (key feature 3: CT scan). Upon confirmation of the diagnosis, students were asked about a diagnostic procedure that can inform risk stratification for this particular patient (key feature 4: PESI score, cardiac ultrasound or troponin measurement). In the fifth section of the case, the patient is no longer haemodynamically stable and requires catecholamine therapy, and students were asked to indicate the therapeutic action required (key feature 5: thrombolysis). A recent review  confirmed that key feature questions lend themselves to the assessment of clinical reasoning, and it has been suggested they could be used in a test-enhanced learning paradigm . We recently reported the findings of a randomised study of repeated testing with key feature questions on outcomes related to clinical reasoning , wherein 6 months after the intervention, students retained significantly more content that had been presented in key feature questions compared to content that had been presented in a didactic format but without interspersed questions (56% vs. 49%; p < 0.001).
While this study showed that repeated case-based testing with key feature questions is more effective than repeated case-based study of the same material, the overall retention of procedural knowledge related to clinical reasoning at the 6-month follow-up was suboptimal. One reason might be that all the case-based material used in that study was presented as text on computer screens. While text can easily be scanned for relevant information, students might have found it harder to immerse in the clinical problem presented. This assumption is supported by psychological research dating back to 1975, when Godden and Baddeley demonstrated the importance of similarities between the learning environment and situations in which the learnt material needs to be recalled . In addition, according to the dual-coding theory  and supporting original research , simultaneous presentation of audio-visual material is more likely to enhance retention of information than verbal material alone. Despite the increasing use of videos in undergraduate medical education, we are not aware of any studies addressing their value when used as part of exams focussing on clinical reasoning.
In summary, test-enhanced learning with video-based, computer-assisted exams could be an efficient way of enhancing student performance with regard to making the right choices about diagnostic tests and taking appropriate therapeutic action. In addition, the avoidance of unnecessary interventions as set out in the Choosing Wisely recommendations can ideally be addressed in key feature questions. To our knowledge, no previous study has reported student performance in this context. In addition, incorrect answers to key feature questions have rarely been analysed although they may reveal specific shortcomings in teaching that could be easily remedied.
This randomised cross-over study was designed to test the hypothesis that repeated testing with video-based key feature questions produces superior retention of procedural knowledge related to clinical reasoning compared to repeated testing with text-based key feature questions. The second aim was to investigate the effects of (non) alignment between presentation formats in the learning phase and subsequent exams on student performance. The third aim of this study was to identify common errors evident in student responses to key feature questions.
This was a randomised, controlled, non-blinded cross-over study involving fourth-year undergraduate medical students. At Göttingen Medical School, clinical reasoning is mainly addressed in study years 4 and 5. In addition to small-group case-based discussions and bedside teaching, students work on predefined patient case histories in computer-based ‘electronic seminars’ (e-seminars) lasting up to 45 min each. E-seminars are facilitated at the institution’s e-learning resource centre.
Students enrolled in the first term of the fourth year were eligible for study participation during the summer of 2015. During the first 14 weeks of term (‘learning phase’), students attended three thematic modules on cardiology, pulmonology, nephrology, rheumatology, haematology and oncology. Following stratification by sex and prior performance levels, they were randomised to one of two groups (A and B). Students in both groups attended weekly e-seminars during which they were presented with three patient case histories related to teaching content of the previous week. Case histories (‘virtual patients’) were adapted from an earlier study ; they had been designed according to a set of principles identified in a previous focus group study among German medical students . Each patient case was broken up into five sections, and at the end of each section, students answered a key feature question on the most appropriate next diagnostic/therapeutic step by entering at least three letters in a box and choosing from a long menu of options provided by the exam software. An example of a key feature question is included in Additional file 1: Methods. Throughout this manuscript, the word ‘item’ refers to one key feature question, i.e. each case was made up of five items.
Case content was identical for all students but the format varied each week between ‘text cases’ or ‘video cases’. In text cases, content was presented on the computer screen in written format while dealing with video cases involved watching five short films (mean duration 68 s), and answering a question (i.e. one item) after each film. Films were scripted based on written cases that had been piloted in two consecutive student cohorts. Wherever possible, videos were closely aligned to text cases. However, inevitably, minor differences arose in the exact wording of content, which are fundamental to the difference between written information and audio-visual material showing a true interaction between a patient and a physician. For a sample video, please refer to Additional file 2.
Additional file 2: Sample video. Example of a video key feature item. This MP4-file is an example of a video key feature item featuring a 74 year-old simulated patient called “Mr. Teschke” (fictional name) with increasing shortness of breath. The interaction was scripted and both the patient and the doctor were played by actors who were not affiliated to the study team. Both individuals consented to participate in the research project and to be shown in this sample video. (MP4 7365 kb)
Given that there were three cases per week, each containing five key feature questions (i.e. items), students answered a total of 150 items during the learning phase. Of these, 14 items in group A were predefined as intervention items which meant that these items were presented as video-based questions. The same items were used as control items (i.e. text-based questions) in group B. Conversely, 14 intervention items for students in group B were used as control items in group A. Item assignment to the two study groups was balanced with regard to item difficulty as derived from an earlier study using the same items . Intervention and control items were scattered across cases, i.e. some cases did not contain any intervention/control item (these cases referred to important teaching content that was, however, not targeted in this study) while other cases contained up to five intervention/control items. All analyses (see below) were carried out on the (aggregated) item level, irrespective of the cases in which they had been embedded.
Each of the 28 intervention/control items was presented in two out of the 10 e-seminars during the learning phase. As a result, any student – regardless of group assignment – was exposed to 14 intervention (video) items in two e-seminars and to 14 control (text) items in two different e-seminars. During the final week of term, students took a formative exit exam consisting of these 28 items that had been arranged into four new cases containing 6 or 8 key features each. Again, cases were only used to provide a structure to accommodate the items, and analyses were done on the item level. A formative retention test was taken 6 months later.
Given the impact of context and format on exam performance with regard to the learning environment , presentation of items in the exit exam and retention test was balanced in that seven out of 14 intervention (video) items for both groups were presented as video items in these exams while the other seven were presented as text items and vice versa. This was done to address the second aim of the study outlined above. Item assignment to presentation format was balanced by item difficulty as derived from the previous study . Thus, from the outset, item difficulty was expected to be similar for the 14 intervention and control items in the two study groups as well as for the 7 video and the 7 text items derived from these (respectively) in the exit exam and retention test. As a consequence, any differences in student performance were more likely to be caused by the intervention than by pre-existing differences in item difficulties.
Descriptive analyses involved calculation of student mean scores achieved for intervention and control items in the three exams as well as in the first and second occurrence of an item in an e-seminar. The primary outcome for this study was the within-subject difference in percent scores in the exit exam for those 14 items that had been presented in video format during the learning phase compared to those 14 items that had been presented in text format. The difference was assessed in a paired T-test. Based on an expected sample size of 90 and the results of a previous study , the study was adequately powered (1 – β = 0.8) to detect a performance difference between video and text items of 8% on an α level of 5%. Performance on items in the retention test was assessed as a function of the number of correct retrievals for the same items during e-seminars and the exit exam. Performance differences as a function of presentation format during the learning phase and the formative exams was assessed using Friedman and Wilcoxon tests. According to the statistical analysis plan, an additional Bayesian approach was scheduled in case one of these analyses yielded a non-significant result. The Bayes factor was to be calculated based on the assumption that the effect of using videos instead of text would be half the size of the effect observed in the mentioned previous study comparing repeated testing to repeated study of clinical cases.
With regard to the third aim of this study, common errors were addressed by calculating the proportion of students making incorrect choices in e-seminars (learning phase) and the exit exam and retention test, respectively.
Statistical analysis was performed using SPSS 22.0 (SPSS Inc., Chicago, Illinois, USA) and the Bayes factor calculator provided by Dienes . Data are presented as mean ± SD or percentages unless otherwise stated. Significance levels were set to p < 0.05. This study was approved by the local Ethics Committee (application number 22/4/15), and all participants provided written consent.
The flow of participants through the study is displayed in Fig. 1. Of the 125 students eligible for study participation, six did not provide written consent. Following exclusion of students due to missing data or contamination (due to exposure to the wrong presentation format at least once), complete data were available for 93 students (effective response rate 74.4%). The mean age of study participants was 25.8 ± 3.9 years, and 64.5% (n = 60) were female.
Association between presentation format during learning and in the formative exams
Impact of alignment between presentation format during e-seminars and formative exams on student performance
Percent scores achieved in the formative exams
77.4 ± 21.0a
71.6 ± 20.4d,e
67.3 ± 22.2a,b
61.3 ± 25.4d,f
79.0 ± 20.2b,c
72.8 ± 23.1f,g
73.4 ± 22.3c
65.6 ± 22.5e,g
Common errors observed in e-seminars and formative exams
Proportions of correct and incorrect answers for the 28 key feature items, calculated across the two e-seminars, and exit exam and the retention test
Key features (Items)
Proportion of correct answers
Frequent or relevant incorrect answers (proportion)
Diagnosis of pulmonary embolism
Acute coronary syndrome (8.0%); aortic dissection (3.9%)
Wells Score to assess likelihood of PE
Assessment of hemodynamic stability (5.2%)
Thorax CT scan to confirm PE in a patient with high clinical probability
Thrombolysis without confirmation (17.7%); other imaging (9.7%); D-dimer testing (9.7%)
Right ventricular strain for risk stratification
Fibrinolysis for unstable pulmonary embolism
Other medical treatment (10.2%)
Diagnosis of secondary hypertension
Essential hypertension (11.5%); cardiac disease (10.4%)
Diagnosis of diastolic dysfunction
Other myocardial disease (60.8%)
Discontinuation of ACE inhibitors due to typical cough
Hospital admission for chronic symptomatic hyponatremia
Rapid sodium supplementation (11.0%)
Thiazide diuretics as cause of hyponatremia
Diagnosis of central pontine myelinolysis following rapid sodium supplementation
Cerebral oedema (13.6%)
Orthostatic challenge after syncope
Tilt testing (22.8%)
ECG diagnosis of tachyarrhythmia
Conduction blocks (13.7%); myocardial infarction (1.9%)
CHA2DS2-VASc score for anticoagulation
Diagnosis of nephrotic syndrome
Nephritic syndrome (8.0%)
Diagnosis of systemic lupus erythematosus
Non-specific glomerulonephritis (4.3%)
Renal biopsy to confirm lupus nephritis
Diagnosis of COPD
Confirmation of COPD by FEV1/VC < 70%
FEV1 (13.6%); FEV1/VC % predicted (15.8%)
ABG analysis for suspected CO2 intoxication
Treatment of CO2 intoxication by non-invasive ventilation
Oxygen (16.9%); CPAP (11.4%); buffering (6.7%)
Diagnosis of left apical pneumonia in a chest X-ray
Incorrect or no localisation (23.3%)
Decision on hospitalisation based on the CRB-65 score
Decision based on additional laboratory tests (5.6%)
Diagnosis of hyperthyroidism from lab results
Stopping amiodarone in a pt. with hyperthyroidism
other medical (11.4%) or surgical (5.7%) treatment
Diagnosis of pulmonary fibrosis
Pulmonary oedema (12.5%); pneumonia (9.4%)
Amiodarone as cause of pulmonary fibrosis
Atrial fibrillation (4.8%)
Indication for long-term oxygen therapy
Mechanical ventilation (24.2%)
This randomised cross-over study yielded two main findings. First, repeated testing with video-based key feature questions elicited higher short-term learning outcomes than testing with text-based questions regarding diagnostic accuracy and initial management issues with only weak evidence in the long-term. Second, we found a high prevalence of erroneous beliefs in medical students irrespective of item format (video or text). These misconceptions have the potential to negatively impact the quality of patient care unless corrected before graduation.
Choosing Wisely – a perspective on medical education
Clinical reasoning abilities are essential for competent and reflective physicians. Undergraduate medical education needs to equip students with a solid knowledge base and train them to apply that knowledge in a given clinical context. The Choosing Wisely recommendations emerged from clinical reasoning processes. Thus, the initiative could serve as a paradigm of quality assurance in clinical care that should be addressed in medical education. Albeit not having been specifically designed to match any of the top five lists, some of the key feature questions embedded in the patient cases presented to our students alluded to current Choosing Wisely recommendations. For example, the lists of both the American College of Chest Physicians and the American College of Emergency Physicians cover the treatment of pulmonary embolism, and our results (Table 2) show that some fourth-year medical students struggle with basic concepts such as confirming the diagnosis before initiating treatment or skipping D-dimer testing in patients with a high probability of pulmonary embolism. Our data also shed light on other misconceptions that may have fatal consequences (e.g. sole oxygen supplementation without ventilator support in CO2 poisoning). Medical education research preferentially focuses on correct responses and aggregate scores. In the light of the Choosing Wisely campaign, a more thorough assessment of misconceptions and frequent errors appears promising in that it could guide improvements in the way clinical reasoning is being taught. This process should be informed by educational research. The present study suggests that repeated testing with key feature questions is effective in enhancing clinical reasoning performance.
Test-enhanced learning for clinical reasoning: a proof of concept
Since the introduction of test-enhanced learning to the field of medical education research, a number of studies on undergraduate medical , dental  and nursing  education have confirmed that repeated testing can be used to enhance retention of knowledge and skills relevant to preclinical  and clinical  medicine. The performance retention rates observed in our study are close to or exceed the upper bound of results reported in previous studies. In two prospective randomised trials involving medical students and residents, respectively, percent scores in retention tests 6 months after a test-based intervention approached 40% [16, 29]. Our study adds to the growing body of literature supporting the principle of test-enhanced learning in medical education by demonstrating that a resource-saving, computer-based intervention can have a beneficial impact on outcomes related to clinical reasoning.
Use of videos in medical education
There is a strong rationale for using audio-visual material in higher education as learning resources that are more closely aligned to the context in which knowledge will be applied is likely to produce more favourable learning outcomes . However, high-quality studies on the effective use of videos in medical education are scarce, and only very few have assessed their potential to enhance clinical reasoning. If anything, the available evidence is apt to raise concerns regarding the validity of effectiveness claims. While video triggers are preferred by students in the context of problem-based learning [30, 31], recent research suggests that video-based problem-based learning cases may disrupt deep critical thinking , and that increased authenticity of instructional formats does not necessarily improve clinical reasoning performance in learners . Our current study lends support to the notion that, when used for key feature testing, videos can enhance short-term retention of knowledge relevant to clinical reasoning. Our finding of a greater performance increase between the first e-seminar and the exit exam for video than for text items may be explained by the fact that videos are most effective in situations where sensory information (that cannot be provided in a text) helps to solve a problem . For example, in a patient with suspected pulmonary fibrosis, the video contained an audio recording of the auscultation. Students watching the video were less likely to incorrectly diagnose this patient as having pulmonary oedema and more likely to spot the right diagnosis (Additional file 1: eTable 2). On the other hand, the wealth of information contained in videos increases cognitive load for learners  and may also increase the effort associated with retrieval in the context of test-enhanced learning. Our data support the theory that effortful retrieval produces superior retention . The results of the Bayesian analysis with regard to long-term retention can be used to inform future studies in terms of priors for future analyses. This is particularly helpful when evaluating costly interventions.
Strengths and limitations
Test-enhanced learning is an emerging concept in medical education, and this is one of the first studies using video-based key feature questions to enhance clinical reasoning performance. The questions used during the learning phase and in formative exams referred to highly prevalent or important clinical problems, and all questions were piloted extensively . The response rate was favourable, and randomisation minimised any effects potentially related to self-selection of students.
Despite these strengths, the generalisability of our findings is limited by the monocentric nature of the study. Given that the cases used focussed on internal medicine, we cannot draw conclusions on the potential of test-enhanced learning with key feature questions for other medical specialties. Finally, this study did not assess whether repeated testing with key feature questions impacts on actual student performance in the clinical setting. Although one study suggests such a link , more research is needed to establish a causal relation between repeated testing and more favourable patient outcomes.
Repeated video-based key feature testing was associated with significantly better clinical reasoning performance compared to text-based testing in the short term. However, student responses revealed a high prevalence of erroneous beliefs that – if applied to the clinical context – are potentially harmful to patients. Efforts to improve clinical reasoning training in medical education are warranted, and the Choosing Wisely campaign lends itself to being part of this process aimed at supporting students to become reflective and competent physicians.
We would like to thank all medical students who devoted their time to this study.
This study was funded by a grant issued by Göttingen Medical School, Georg-August-University Göttingen.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
SL helped to design the study, co-ordinated and facilitated video productions, uploaded cases, and helped to collect and analyse data. NS provided comments on all video scripts, participated in filming sessions, helped interpret the data and commented on various versions of the manuscript. JB was involved in Bayesian data analysis and contributed to the Background and Discussion section. SA helped to design the study, provided advice on data presentation and commented on various versions of the manuscript. TR conceived of the study, developed its design, drafted key feature cases, analysed the data and wrote the manuscript. All authors read and approved the final manuscript.
Ethics approval and consent to participate
This study was approved by the local Ethics Committee (application number 22/4/15), and all participants provided written consent.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Croskerry P. A universal model of diagnostic reasoning. Acad Med. 2009;84(8):1022–8.View ArticlePubMedGoogle Scholar
- Cassel CK, Guest JA. Choosing wisely: helping physicians and patients make smart decisions about their care. JAMA. 2012;307(17):1801–2.View ArticlePubMedGoogle Scholar
- Brody H. Medicine’s ethical responsibility for health care reform--the top five list. N Engl J Med. 2010;362(4):283–5.View ArticlePubMedGoogle Scholar
- Jung N, Lehmann C, Fatkenheuer G. The “choosing wisely” initiative in infectious diseases. Infection. 2015;45(3):263–8.Google Scholar
- Hicks LK, Bering H, Carson KR, Haynes AE, Kleinerman J, Kukreti V, Ma A, Mueller BU, O’Brien SH, Panepinto JA, et al. Five hematologic tests and treatments to question. Blood. 2014;124(24):3524–8.View ArticlePubMedGoogle Scholar
- Langer-Gould AM, Anderson WE, Armstrong MJ, Cohen AB, Eccher MA, Iverson DJ, Potrebic SB, Becker A, Larson R, Gedan A, et al. The American Academy of Neurology’s top five choosing wisely recommendations. Neurology. 2013;81(11):1004–11.View ArticlePubMedGoogle Scholar
- Kassirer JP. Teaching clinical reasoning: case-based and coached. Acad Med. 2010;85(7):1118–24.View ArticlePubMedGoogle Scholar
- Dequeker J, Jaspaert R. Teaching problem-solving and clinical reasoning: 20 years experience with video-supported small-group learning. Med Educ. 1998;32(4):384–9.View ArticlePubMedGoogle Scholar
- Spencer J. Learning and teaching in the clinical environment. BMJ. 2003;326(7389):591–4.View ArticlePubMedPubMed CentralGoogle Scholar
- Cook DA, Triola MM. Virtual patients: a critical literature review and proposed next steps. Med Educ. 2009;43(4):303–11.View ArticlePubMedGoogle Scholar
- Wahlgren CF, Edelbring S, Fors U, Hindbeck H, Stahle M. Evaluation of an interactive case simulation system in dermatology and venereology for medical students. BMC Med Educ. 2006;6:40.View ArticlePubMedPubMed CentralGoogle Scholar
- Berman NB, Durning SJ, Fischer MR, Huwendiek S, Triola MM. The role for virtual patients in the future of medical education. Acad Med. 2016;91(9):1217–22.View ArticlePubMedGoogle Scholar
- Karpicke JD, Roediger HL 3rd. The critical importance of retrieval for learning. Science. 2008;319(5865):966–8.View ArticlePubMedGoogle Scholar
- Roediger HL, Karpicke JD. The power of testing memory - basic research and implications for educational practice. Perspect Psychol Sci. 2006;1(3):181–210.View ArticlePubMedGoogle Scholar
- McConnell MM, St-Onge C, Young ME. The benefits of testing for learning on later performance. Adv Health Sci Educ Theory Pract. 2015;20(2):305–20.View ArticlePubMedGoogle Scholar
- Larsen DP, Butler AC, Roediger HL 3rd. Comparative effects of test-enhanced learning and self-explanation on long-term retention. Med Educ. 2013;47(7):674–82.View ArticlePubMedGoogle Scholar
- Kromann CB, Jensen ML, Ringsted C. Test-enhanced learning may be a gender-related phenomenon explained by changes in cortisol level. Med Educ. 2011;45(2):192–9.View ArticlePubMedGoogle Scholar
- Hrynchak P, Takahashi SG, Nayer M. Key-feature questions for assessment of clinical reasoning: a literature review. Med Educ. 2014;48(9):870–83.View ArticlePubMedGoogle Scholar
- Larsen DP, Butler AC, Roediger HL 3rd. Test-enhanced learning in medical education. Med Educ. 2008;42(10):959–66.View ArticlePubMedGoogle Scholar
- Raupach T, Andresen JC, Meyer K, Strobel L, Koziolek M, Jung W, Brown J, Anders S. Test-enhanced learning of clinical reasoning: a crossover randomised trial. Med Educ. 2016;50(7):711–20.View ArticlePubMedGoogle Scholar
- Godden DR, Baddeley A. Context-dependent memory in two natural environments: on land and underwater. Br J Psychol. 1975;66(3):325–31.View ArticleGoogle Scholar
- Paivio A. Imagery and Verbal Processes. New York: Holt, Rinehart and Winston; 1971.Google Scholar
- Mayer RE, Sims VK. For whom is a picture worth a thousand words? Extensions of a dual-coding theory of multimedia learning. J Educ Psychol. 1994;86(3):389–401.View ArticleGoogle Scholar
- Huwendiek S, Reichert F, Bosse HM, de Leng BA, van der Vleuten CP, Haag M, Hoffmann GF, Tonshoff B. Design principles for virtual patients: a focus group study among students. Med Educ. 2009;43(6):580–8.View ArticlePubMedGoogle Scholar
- Dienes Z. Understanding Psychology as a Science: An Introduction to Scientific and Statistical Inference. Hampshire: Palgrave Macmillan; 2008.Google Scholar
- Baghdady M, Carnahan H, Lam EW, Woods NN. Test-enhanced learning and its effect on comprehension and diagnostic accuracy. Med Educ. 2014;48(2):181–8.View ArticlePubMedGoogle Scholar
- Dobson JL, Linderholm T. Self-testing promotes superior retention of anatomy and physiology information. Adv Health Sci Educ Theory Pract. 2015;20(1):149–61.View ArticlePubMedGoogle Scholar
- Logan JM, Thompson AJ, Marshak DW. Testing to enhance retention in human anatomy. Anat Sci Educ. 2011;4(5):243–8.View ArticlePubMedPubMed CentralGoogle Scholar
- Larsen DP, Butler AC, Roediger HL 3rd. Repeated testing improves long-term retention relative to repeated study: a randomised controlled trial. Med Educ. 2009;43(12):1174–81.View ArticlePubMedGoogle Scholar
- Chan LK, Patil NG, Chen JY, Lam JC, Lau CS, Ip MS. Advantages of video trigger in problem-based learning. Med Teach. 2010;32(9):760–5.View ArticlePubMedGoogle Scholar
- de Leng B, Dolmans D, van de Wiel M, Muijtjens A, van der Vleuten C. How video cases should be used as authentic stimuli in problem-based medical education. Med Educ. 2007;41(2):181–8.View ArticlePubMedGoogle Scholar
- Basu Roy R, McMahon GT. Video-based cases disrupt deep critical thinking in problem-based learning. Med Educ. 2012;46(4):426–35.View ArticlePubMedGoogle Scholar
- La Rochelle JS, Durning SJ, Pangaro LN, Artino AR, van der Vleuten CP, Schuwirth L. Authenticity of instruction and student performance: a prospective randomised trial. Med Educ. 2011;45(8):807–17.View ArticlePubMedGoogle Scholar
- Woodham LA, Ellaway RH, Round J, Vaughan S, Poulton T, Zary N. Medical student and tutor perceptions of video versus text in an interactive online virtual patient for problem-based learning: a pilot study. J Med Internet Res. 2015;17(6):e151.View ArticlePubMedPubMed CentralGoogle Scholar
- Sweller J, van Merrienboer J, Paas F. Cognitive architecture and instructional design. Educ Psychol Rev. 1998;10:251–96.View ArticleGoogle Scholar
- Larsen DP, Butler AC, Lawson AL, Roediger HL 3rd. The importance of seeing the patient: test-enhanced learning with standardized patients and written tests improves clinical application of knowledge. Adv Health Sci Educ Theory Pract. 2013;18(3):409–25.View ArticlePubMedGoogle Scholar