scholarly journals Isolating red flags to enhance diagnosis (I-RED): An experimental vignette study

Author(s):  
Corey Chartan ◽  
Hardeep Singh ◽  
Parthasarathy Krishnamurthy ◽  
Moushumi Sur ◽  
Ashley Meyer ◽  
...  

Abstract Objective To investigate effects of a cognitive intervention based on isolation of red flags (I-RED) on diagnostic accuracy of ‘do-not-miss diagnoses.’ Design A 2 × 2 randomized case vignette-based experiment with manipulation of I-RED strategy between subjects and case complexity within subjects. Setting Two university-based residency programs. Participants One-hundred and nine pediatric residents from all levels of training. Interventions Participants were randomly assigned to the I-RED vs. control group, and within each group, they were further randomized to the order in which they saw simple and complex cases. The I-RED strategy involved an instruction to look for a constellation of symptoms, signs, clinical data or circumstances that should heighten suspicion for a serious condition. Main Outcome Measures Primary outcome was diagnostic accuracy, scored as 1 if any of the three differentials given by participants included the correct diagnosis, and 0 if not. We analyzed effects of I-RED strategy on diagnostic accuracy using logistic regression. Results I-RED strategy did not yield statistically higher diagnostic accuracy compared to controls (62 vs. 48%, respectively; odd ratio = 2.07 [95% confidence interval, 0.78–5.5], P = 0.14) although participants reported higher decision confidence compared to controls (7.00 vs. 5.77 on a scale of 1 to 10, P < 0.02) in simple but not complex cases. I-RED strategy significantly shortened time to decision (460 vs. 657 s, P < 0.001) and increased the number of red flags generated (3.04 vs. 2.09, P < 0.001). Conclusions A cognitive strategy of prompting red flag isolation prior to differential diagnosis did not improve diagnostic accuracy of ‘do-not-miss diagnoses.’ Given the paucity of evidence-based solutions to reduce diagnostic error and the intervention’s potential effect on confidence, findings warrant additional exploration.

Diagnosis ◽  
2021 ◽  
Vol 0 (0) ◽  
Author(s):  
Maria R. Dahm ◽  
Carmel Crock

Abstract Objectives To investigate from a linguistic perspective how clinicians deliver diagnosis to patients, and how these statements relate to diagnostic accuracy. Methods To identify temporal and discursive features in diagnostic statements, we analysed 16 video-recorded interactions collected during a practice high-stakes exam for internationally trained clinicians (25% female, n=4) to gain accreditation to practice in Australia. We recorded time spent on history-taking, examination, diagnosis and management. We extracted and deductively analysed types of diagnostic statements informed by literature. Results Half of the participants arrived at the correct diagnosis, while the other half misdiagnosed the patient. On average, clinicians who made a diagnostic error took 30 s less in history-taking and 30 s more in providing diagnosis than clinicians with correct diagnosis. The majority of diagnostic statements were evidentialised (describing specific observations (n=24) or alluding to diagnostic processes (n=7)), personal knowledge or judgement (n=8), generalisations (n=6) and assertions (n=4). Clinicians who misdiagnosed provided more specific observations (n=14) than those who diagnosed correctly (n=9). Conclusions Interactions where there is a diagnostic error, had shorter history-taking periods, longer diagnostic statements and featured more evidence. Time spent on history-taking and diagnosis, and use of evidentialised diagnostic statements may be indicators for diagnostic accuracy.


CJEM ◽  
2014 ◽  
Vol 16 (01) ◽  
pp. 34-40 ◽  
Author(s):  
Jonathan Sherbino ◽  
Kulamakan Kulasegaram ◽  
Elizabeth Howey ◽  
Geoffrey Norman

ABSTRACT Objectives: Cognitive forcing strategies (CFS)may reduce error arising from cognitive biases. This is the first experimental test to determine the effect of CFS training in medical students. Methods: Students were allocated to CFS training or control during a 4-week emergency medicine rotation (n = 191). At the end of the rotation examination, students were tested using computer-based cases. Application of CFS could enable reduction of diagnostic error, as evidenced by identifying multiple correct diagnoses for the two cases prone to search satisficing bias (SSB) and uncommon diagnoses for the two cases prone to availability bias (AB). Two “false positive” cases were included to test for possible “oversearching.” Results: There were 145 students in the intervention and 46 in the control group. For the SSB cases, 52% of students with CFS training and 48% in the control group initiated a search for the second diagnosis (χ2 = 0.13, df = 1, p = 0.91). More than half (54%) correctly identified the second diagnosis in the CFS group, and 48% identified it in the control group. The difference was not significant (χ2 = 2.25, df = 1, p = 0.13). For the second diagnosis in the false positive cases, 64% of the CFS group and 77% of the control group incorrectly identified it. There were no significant differences between groups (χ2 = 2.38, df = 1, p = 0.12). In the AB cases, only 45% in each group identified the uncommon correct diagnosis (χ2 = 0.001, df = 1, p = 0.98). Conclusions: The educational interventions suggested by experts in clinical reasoning and employed in our study to teach CFS failed to show any reduction in diagnostic error by novices.


2021 ◽  
Vol 23 (1) ◽  
Author(s):  
Johannes Knitza ◽  
Koray Tascilar ◽  
Eva Gruber ◽  
Hannah Kaletta ◽  
Melanie Hagen ◽  
...  

Abstract Background An increasing number of diagnostic decision support systems (DDSS) exist to support patients and physicians in establishing the correct diagnosis as early as possible. However, little evidence exists that supports the effectiveness of these DDSS. The objectives were to compare the diagnostic accuracy of medical students, with and without the use of a DDSS, and the diagnostic accuracy of the DDSS system itself, regarding the typical rheumatic diseases and to analyze the user experience. Methods A total of 102 medical students were openly recruited from a university hospital and randomized (unblinded) to a control group (CG) and an intervention group (IG) that used a DDSS (Ada – Your Health Guide) to create an ordered diagnostic hypotheses list for three rheumatic case vignettes. Diagnostic accuracy, measured as the presence of the correct diagnosis first or at all on the hypothesis list, was the main outcome measure and evaluated for CG, IG, and DDSS. Results The correct diagnosis was ranked first (or was present at all) in CG, IG, and DDSS in 37% (40%), 47% (55%), and 29% (43%) for the first case; 87% (94%), 84% (100%), and 51% (98%) in the second case; and 35% (59%), 20% (51%), and 4% (51%) in the third case, respectively. No significant benefit of using the DDDS could be observed. In a substantial number of situations, the mean probabilities reported by the DDSS for incorrect diagnoses were actually higher than for correct diagnoses, and students accepted false DDSS diagnostic suggestions. DDSS symptom entry greatly varied and was often incomplete or false. No significant correlation between the number of symptoms extracted and diagnostic accuracy was seen. It took on average 7 min longer to solve a case using the DDSS. In IG, 61% of students compared to 90% in CG stated that they could imagine using the DDSS in their future clinical work life. Conclusions The diagnostic accuracy of medical students was superior to the DDSS, and its usage did not significantly improve students’ diagnostic accuracy. DDSS usage was time-consuming and may be misleading due to prompting wrong diagnoses and probabilities. Trial registration DRKS.de, DRKS00024433. Retrospectively registered on February 5, 2021.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
J. Staal ◽  
J. Alsma ◽  
S. Mamede ◽  
A. P. J. Olson ◽  
G. Prins-van Gilst ◽  
...  

Abstract Background Diagnostic errors have been attributed to cognitive biases (reasoning shortcuts), which are thought to result from fast reasoning. Suggested solutions include slowing down the reasoning process. However, slower reasoning is not necessarily more accurate than faster reasoning. In this study, we studied the relationship between time to diagnose and diagnostic accuracy. Methods We conducted a multi-center within-subjects experiment where we prospectively induced availability bias (using Mamede et al.’s methodology) in 117 internal medicine residents. Subsequently, residents diagnosed cases that resembled those bias cases but had another correct diagnosis. We determined whether residents were correct, incorrect due to bias (i.e. they provided the diagnosis induced by availability bias) or due to other causes (i.e. they provided another incorrect diagnosis) and compared time to diagnose. Results We did not successfully induce bias: no significant effect of availability bias was found. Therefore, we compared correct diagnoses to all incorrect diagnoses. Residents reached correct diagnoses faster than incorrect diagnoses (115 s vs. 129 s, p < .001). Exploratory analyses of cases where bias was induced showed a trend of time to diagnose for bias diagnoses to be more similar to correct diagnoses (115 s vs 115 s, p = .971) than to other errors (115 s vs 136 s, p = .082). Conclusions We showed that correct diagnoses were made faster than incorrect diagnoses, even within subjects. Errors due to availability bias may be different: exploratory analyses suggest a trend that biased cases were diagnosed faster than incorrect diagnoses. The hypothesis that fast reasoning leads to diagnostic errors should be revisited, but more research into the characteristics of cognitive biases is important because they may be different from other causes of diagnostic errors.


2020 ◽  
Vol 20 (2) ◽  
pp. 101-120
Author(s):  
Ayça Aktaç Gürbüz ◽  
Orçun YORULMAZ ◽  
Gülşah DURNA

Scientific research into the reduction of stigmatization, particularly related to specific problems such as Obsessive-Compulsive Disorder (OCD), is scarce. In the present study, we examine the impact of a video-based antistigma intervention program for OCD in a pretest-posttest control group research. After being randomly assigned to either an intervention (n= 101) or control group (n= 96), the participants reported their attitudes on a hypothetical case vignette before and after OCD vs. Multiple Sclerosis (MS) videos, and again six months later as a follow up assessment. The mixed design analyses for the group comparisons indicated that although there was no significant difference in the measures of the control group, the participants watching the anti-stigma OCD video, in which the focus was psychoeducation and interaction strategies, reported significantly lower scores on social distances and negative beliefs for the case vignettes they read, and this difference was maintained six months later. Then, the present results indicate the effectiveness of our anti-stigma intervention program for OCD. Interventions to reduce stigmatization can also be viewed as effective tools for changing the attitudes of people toward OCD, although further research and applications are needed related to specific disorders if a longlasting impact is to be achieved.


2020 ◽  
Vol 79 (Suppl 1) ◽  
pp. 1961.1-1961
Author(s):  
J. Knitza ◽  
J. Mohn ◽  
C. Bergmann ◽  
E. Kampylafka ◽  
M. Hagen ◽  
...  

Background:Symptom checkers (SC) promise to reduce diagnostic delay, misdiagnosis and effectively guide patients through healthcare systems. They are increasingly used, however little evidence exists about their real-life effectiveness.Objectives:The aim of this study was to evaluate the diagnostic accuracy, usage time, usability and perceived usefulness of two promising SC, ADA (www.ada.com) and Rheport (www.rheport.de). Furthermore, symptom duration and previous symptom checking was recorded.Methods:Cross-sectional interim clinical data from the first of three recruiting centers from the prospective, real-world, multicenter bETTeR-study (DKRS DRKS00017642) was used. Patients newly presenting to a secondary rheumatology outpatient clinic between September and December 2019 completed the ADA and Rheport SC. The time and answers were recorded and compared to the patient’s actual diagnosis. ADA provides up to 5 disease suggestions, Rheport calculates a risk score for rheumatic musculoskeletal diseases (RMDs) (≥1=RMD). For both SC the sensitivity, specificity was calculated regarding RMDs. Furthermore, patients completed a survey evaluating the SC usability using the system usability scale (SUS), perceived usefulness, previous symptom checking and symptom duration.Results:Of the 129 consecutive patients approached, 97 agreed to participate. 38% (37/97) of the presenting patients presented with an RMD (Figure 1). Mean symptom duration was 146 weeks and a mean number of 10 physician contacts occurred previously, to evaluate current symptoms. 56% (54/96) had previously checked their symptoms on the internet using search engines, spending a mean of 6 hours. Rheport showed a sensitivity of 49% (18/37) and specificity of 58% (35/60) concerning RMDs. ADA’s top 1 and top 5 disease suggestions concerning RMD showed a sensitivity of 43% (16/37) and 54% (20/37) and a specificity of 58% (35/60) and 52% (31/60), respectively. ADA listed the correct diagnosis of the patients with RMDs first or within the first 5 disease suggestions in 19% (7/37) and 30% (11/37), respectively. The average perceived usefulness for checking symptoms using ADA, internet search engines and Rheport was 3.0, 3.5 and 3.1 on a visual analog scale from 1-5 (5=very useful). 61% (59/96) and 64% (61/96) would recommend using ADA and Rheport, respectively. The mean SUS score of ADA and Rheport was 72/100 and 73/100. The mean usage time for ADA and Rheport was 8 and 9 minutes, respectively.Conclusion:This is the first prospective, real-world, multicenter study evaluating the diagnostic accuracy and other features of two currently used SC in rheumatology. These interim results suggest that diagnostic accuracy is limited, however SC are well accepted among patients and in some cases, correct diagnosis can be provided out of the pocket within few minutes, saving valuable time.Figure:Acknowledgments:This study was supported by an unrestricted research grant from Novartis.Disclosure of Interests:Johannes Knitza Grant/research support from: Research Grant: Novartis, Jacob Mohn: None declared, Christina Bergmann: None declared, Eleni Kampylafka Speakers bureau: Novartis, BMS, Janssen, Melanie Hagen: None declared, Daniela Bohr: None declared, Elizabeth Araujo Speakers bureau: Novartis, Lilly, Abbott, Matthias Englbrecht Grant/research support from: Roche Pharma, Chugai Pharma Europe, Consultant of: AbbVie, Roche Pharma, RheumaDatenRhePort GbR, Speakers bureau: AbbVie, Celgene, Chugai Pharma Europe, Lilly, Mundipharma, Novartis, Pfizer, Roche Pharma, UCB, David Simon Grant/research support from: Else Kröner-Memorial Scholarship, Novartis, Consultant of: Novartis, Lilly, Arnd Kleyer Consultant of: Lilly, Gilead, Novartis,Abbvie, Speakers bureau: Novartis, Lilly, Timo Meinderink: None declared, Wolfgang Vorbrüggen: None declared, Cay-Benedict von der Decken: None declared, Stefan Kleinert Shareholder of: Morphosys, Grant/research support from: Novartis, Consultant of: Novartis, Speakers bureau: Abbvie, Novartis, Celgene, Roche, Chugai, Janssen, Andreas Ramming Grant/research support from: Pfizer, Novartis, Consultant of: Boehringer Ingelheim, Novartis, Gilead, Pfizer, Speakers bureau: Boehringer Ingelheim, Roche, Janssen, Jörg Distler Grant/research support from: Boehringer Ingelheim, Consultant of: Boehringer Ingelheim, Paid instructor for: Boehringer Ingelheim, Speakers bureau: Boehringer Ingelheim, Peter Bartz-Bazzanella: None declared, Georg Schett Speakers bureau: AbbVie, BMS, Celgene, Janssen, Eli Lilly, Novartis, Roche and UCB, Axel Hueber Grant/research support from: Novartis, Lilly, Pfizer, Consultant of: Abbvie, BMS, Celgene, Gilead, GSK, Lilly, Novartis, Speakers bureau: GSK, Lilly, Novartis, Martin Welcker Grant/research support from: Abbvie, Novartis, UCB, Hexal, BMS, Lilly, Roche, Celgene, Sanofi, Consultant of: Abbvie, Actelion, Aescu, Amgen, Celgene, Hexal, Janssen, Medac, Novartis, Pfizer, Sanofi, UCB, Speakers bureau: Abbvie, Aescu, Amgen, Biogen, Berlin Chemie, Celgene, GSK, Hexal, Mylan, Novartis, Pfizer, UCB


2018 ◽  
Vol 88 (3) ◽  
Author(s):  
Sergio C. Conte ◽  
Giulia Spagnol ◽  
Marco Confalonieri ◽  
Beatrice Brizi

The sedation plays an important role in the endobronchial ultrasound transbronchial needle aspiration (EBUS-TBNA) procedure. The sedation can be Minimal (anxiolysis), Moderate (conscious sedation) or Deep. The ACCP guidelines suggest that moderate or deep sedation (DS) is an acceptable approach. In fact, several studies compare moderate versus deep sedation, but no study has been carried out to compare deep sedation versus minimal. We carried out a retrospective study to compare the Deep versus Minimal sedation (MiS) in patients undergoing EBUS-TBNA.  The primary end point was the diagnostic accuracy. The secondary end points were adequacy and sensitivity. We evaluated the LN size sampling, procedural time, complications and patient tolerance. Thirty-six patients underwent EBUS-TBNA, 16 under DS and 20 under MiS. The overall diagnostic accuracy for correct diagnosis was 92.9% in DS group and 94.1% in MiS group (p=0.554). Sample adequacy, defined as the percentage of patients with a specific diagnosis by EBUS-TBNA, was 87.5% (14 of 16) and 85% (17 of 20) for the DS group and MiS group, respectively, (p=0.788); the sensitivity was 92.9% in the DS group (95% CI, 73-100%) and 92.9% in the MiS group (95% CI, 77-100%) (p=0.463). There were no major complications in either group. Minor complications were 4 in MiS and 1 in DS (p=0.355).  The patients in the MiS group recalled the procedure more often compared to the other group (p=0.041). The majority of the patients would agree to undergo the same procedure again in the future in both groups (p=0.766).  In our experience EBUS-TBNA performed under MiS has comparable accuracy, adequacy, sensitivity, complications and patient satisfaction to DS, even if the sample was small.  Future prospective multicenter studies are needed to confirm our results.


2020 ◽  
Vol 9 (6) ◽  
pp. 1831
Author(s):  
Elena Khashchenko ◽  
Elena Uvarova ◽  
Mikhail Vysokikh ◽  
Tatyana Ivanets ◽  
Lyubov Krechetova ◽  
...  

Relevance: The clinical picture of polycystic ovary syndrome (PCOS) is extremely polymorphic, especially in adolescence. At the same time, the diagnostic criteria of PCOS in adolescence are still under discussion, and the hormonal parameters, including anti-Mullerian hormone range and hyperandrogenism, are not determined. The aim of the present study was to characterize the pivotal clinical and hormonal features of PCOS in adolescents and to establish the age-specific thresholds of the most essential hormonal parameters. Design: A case-control study. Methods: The study included 130 girls with PCOS according to the complete Rotterdam criteria, aged 15 to 17 years. The control group consisted of 30 healthy girls with a regular menstrual cycle of the same age. A complete clinical and laboratory examination, hormonal assays, and ultrasound of the pelvic organs were performed. The serums anti-Mullerian hormone (AMH), follicle-stimulating hormone (FSH), luteinizing hormone (LH), LH/FSH, prolactin, estradiol, 17α-OH progesterone (17α-OHP), androstenedione, testosterone (T), dehydroepiandrosterone sulfate (DHEAS), sex hormone-binding globulin (SHBG), leptin, and free androgen index (FAI) were analyzed. The diagnostic accuracy of AMH, FAI, LH/FSH, T, and androstenedione levels in predicting PCOS in adolescents was established using a logistic regression model and calculating area under the receiver operator characteristic (ROC) curve (AUC). Results: The serum levels of LH (9.0 (5.4–13.8) vs. 3.7 (2.5–4.7) IU/L; p < 0.0001), LH/FSH (1.6 (1.0–2.3) vs. 0.7 (0.5–1.1); p < 0.0001), 17α–OHP (4.1 (3.2–5.1) vs. 3.4 (2.7–3.8) nmol/L; p = 0.0071), cortisol (464.0 ± 147.6 vs. 284.0 ± 129.7 nmol/L; p < 0.0001), prolactin (266.0 (175.0–405.0) vs. 189.0 (142.0–269.0) mIU/L; p = 0.0141), T (1.9 (1.2–2.5) vs. 0.8 (0.7–1.1) nmol/L; p < 0.0001), androstenedione (15.8 (11.6–23.2) vs. 8.3 (6.5–10.8) ng/mL; p < 0.0001), AMH (9.5 (7.5–14.9) vs. 5.8 (3.8–6.9) ng/mL; p < 0.0001), FAI (5.5 (2.8–7.0) vs. 1.6 (1.1–2.3); p < 0.0001), SHBG (37.0 (24.7–55.5) vs. 52.9 (39.0–67.6) nmol/L; p = 0.0136), DHEAS (6.8 ± 3.2 vs. 5.1 ± 1.5 μmol/L; p = 0.0039), and leptin (38.7 ± 27.1 vs. 23.7 ± 14.0 ng/mL; p = 0.0178) were significantly altered in the PCOS patients compared to the controls. Multivariate analysis of all studied hormonal and instrumental parameters of PCOS in adolescents revealed as the most essential: AMH level > 7.20 ng/mL, FAI > 2.75, androstenedione > 11.45 ng/mL, total T > 1.15 nmol/L, LH/FSH ratio > 1.23, and the volume of each ovary > 10.70 cm3 (for each criterion sensitivity ≥ 75.0–93.0%, specificity ≥ 83.0–93.0%). The diagnostic accuracy of PCOS determination was 90.2–91.6% with the combined use of either four detected indexes, which was significantly higher than the use of each index separately. The accuracy of PCOS diagnostics reached 92% using AMH and leptin concentrations when the value of the logistic regression function [85.73 − (1.73 × AMH) − (0.12 × Leptin)] was less than 70.72. Conclusions: The results of the study estimate the threshold for AMH, FAI, androstenedione, testosterone, LH/FSH, and ovarian volume, which could be suggested for use in the PCOS diagnostics in adolescents with a high sensitivity and specificity. Moreover, the combination of either four determined indexes improved the diagnostic accuracy for the PCOS detection in adolescents.


2016 ◽  
Vol 22 (5) ◽  
pp. 577-582 ◽  
Author(s):  
Israel Contador ◽  
Bernardino Fernández-Calvo ◽  
Francisco Ramos ◽  
Javier Olazarán

AbstractObjectives: This research retrospectively analyzed the effect of education on cognitive interventions carried out in patients with mild Alzheimer’s disease (AD). Methods: The total sample consisted of 75 patients with mild AD receiving treatment with cholinesterase inhibitors. The participants were divided into two groups: cognitive intervention (IG; n=45) and waiting list (WLG; n=30). Patients in the IG received either the Big Brain Academy (n=15) or the Integrated Psychostimulation Program (n=30) during 12 weeks. The influence of education on intervention effect was analyzed comparing mean change scores of the two study groups in the cognitive subscale of the Alzheimer’s Disease Assessment Scale (ADAS-cog), stratified by educational level. The potential effect of age, sex, cognitive status, and type of intervention was examined using post hoc stratification analyses. Results: Higher education was associated with faster cognitive decline in the WLG (effect size=0.51; p<.01). However, cognitive evolution was not influenced by education in the IG (effect size=0.12; p=.42). Conclusions: Our results suggest that cognitive intervention might delay accelerated cognitive decline in higher educated individuals with mild AD. (JINS, 2016, 23, 1–6)


Author(s):  
Samuel Browning ◽  
E. Scott Geller

To investigate the impact of writing a gratitude letter on particular mood states, we asked students in two university classes (a research class and a positive psychology class) to complete a 15-item mood assessment survey (MAS) twice a day (once in the morning and once at night). The research students who signed up for one or two pass/fail field-study credits in a research class also completed the MAS twice a day, but they did not write the weekly gratitude letter that was expected from the students in the positive psychology class. Each mood state was averaged per each day for the participants in each group and compared between the Gratitude Group and the Control Group. No group difference occurred for some mood states like “incompetent,” but for the “unmotivated” mood state, a significant difference was found. To investigate the potential effect of weekday, we compared the average mood rating between groups for each day of the week. For the mood state of “unmotivated”, a remarkable dip occurred on Wednesday for the Gratitude group, but not for the Control group. These results indicated that writing a gratitude letter increased the benefactor’s motivation, especially on the day when it was accomplished.


Sign in / Sign up

Export Citation Format

Share Document