scholarly journals Harnessing the Wisdom of the Confident Crowd in Medical Image Decision-making

2021 ◽  
Author(s):  
Eeshan Hasan ◽  
Quentin Eichbaum ◽  
Adam Seegmiller ◽  
Charles Stratton ◽  
Jennifer Trueblood

Improving the accuracy of medical image interpretation is critical to improving the diagnosis of many diseases. Using both novices (undergraduates) and experts (medical professionals), we investigated methods for improving the accuracy of a single decision maker and a group of decision makers by aggregating repeated decisions in different ways. Participants made classification decisions (cancerous versus non-cancerous) and confidence judgments on a series of cell images, viewing and classifying each image twice. We first examined whether it is possible to improve individual-level performance by using the maximum confidence slating algorithm (Koriat, 2012b), which leverages metacognitive ability by using the most confident response for an image as the ‘final response’. We find maximum confidence slating improves individual classification accuracy for both novices and experts. Building on these results, we show that aggregation algorithms based on confidence weighting scale to larger groups of participants, dramatically improving diagnostic accuracy, with the performance of groups of novices reaching that of individual experts. In sum, we find that repeated decision making and confidence weighting can be a valuable way to improve accuracy in medical image decision-making and that these techniques can be used in conjunction with each other.

1984 ◽  
Vol 78 (4) ◽  
pp. 912-928 ◽  
Author(s):  
Peter F. Nardulli ◽  
Roy B. Flemming ◽  
James Eisenstein

This article uses a variety of multilevel data collected from a nine-county study of felony courts to examine the joint effects of contextual and individual level (sociopolitical characteristics of decision workers) upon decisions made in face-to-face groups. The research finds that although the sociopolitical characteristics of decision makers (attitudes toward punishment, Machiavellianism, and operating styles) made a difference in the outcome of interactions, their role could not be accessed independent of the contextual factors surrounding the interactions. Some of the most important contextual factors were the kind of criminal case being handled, prosecutor office policies restricting discretion, and the configuration of attributes in the group handling the case. Although the data are wholly derived from the criminal court setting, the implications of the findings for studying decision making in other face-to-face groups are developed.


2018 ◽  
Author(s):  
Max Edward Butterfield ◽  
Alexandra N. Bitter

Social judgments in ambiguous situations often rely on heuristics and biases, and legal decision makers are often faced with evidence that does not clearly favor one decision over another. Across two studies, we tested whether one extralegal factor, contrast cases, influenced decision making when judicial factors were held constant. In Study 1, participants (n = 100) evaluated whether an imagined prosecutor had sufficient evidence to send the same three target cases to trial. Before deciding these cases, though, the participants first evaluated cases with either relatively stronger or weaker evidence than the targets. Those in the weak-case comparison group were significantly more likely to send target cases to trial, and they believed the prosecutor had a stronger case. In Study 2, all participants (n = 100) evaluated hypothetical parole applications, but the method was otherwise the same as that used in Study 1. The same contrast-oriented pattern emerged. Participants who first viewed weaker parole applications rated the identical targets as significantly more rehabilitated. Taken together, the results of these two studies suggest that contrast effects may be one extralegal factor involved in shaping individual-level social judgments made in legal contexts such as grand juries and parole boards.


BJGP Open ◽  
2020 ◽  
Vol 4 (3) ◽  
pp. bjgpopen20X101096 ◽  
Author(s):  
Alison Jayne Doherty ◽  
Paul Boland ◽  
Janet Reed ◽  
Andrew J Clegg ◽  
Anne-Marie Stephani ◽  
...  

BackgroundManaging polypharmacy is a challenge for healthcare systems globally. It is also a health inequality concern as it can expose some of the most vulnerable in society to unnecessary medications and adverse drug-related events. Care for most patients with multimorbidity and polypharmacy occurs in primary care. Safe deprescribing interventions can reduce exposure to inappropriate polypharmacy. However, these are not fully accepted or routinely implemented.AimTo identify barriers and facilitators to safe deprescribing interventions for adults with multimorbidity and polypharmacy in primary care.Design & settingA systematic review of studies published from 2000, examining safe deprescribing interventions for adults with multimorbidity and polypharmacy.MethodA search of electronic databases: MEDLINE, Embase, Cumulative Index of Nursing and Allied Health Literature (CINHAL), Cochrane, and Health Management Information Consortium (HMIC) from inception to 26 Feb 2019, using an agreed search strategy. This was supplemented by handsearching of relevant journals, and screening of reference lists and citations of included studies.ResultsIn total, 40 studies from 14 countries were identified. Cultural and organisational barriers included: a culture of diagnosing and prescribing; evidence-based guidance focused on single diseases; a lack of evidence-based guidance for the care of older people with multimorbidities; and a lack of shared communication, decision-making systems, tools, and resources. Interpersonal and individual-level barriers included: professional etiquette; fragmented care; prescribers’ and patients’ uncertainties; and gaps in tailored support. Facilitators included: prudent prescribing; greater availability and acceptability of non-pharmacological alternatives; resources; improved communication, collaboration, knowledge, and understanding; patient-centred care; and shared decision-making.ConclusionA whole systems, patient-centred approach to safe deprescribing interventions is required, involving key decision-makers, healthcare professionals, patients, and carers.


2018 ◽  
Vol 17 (3) ◽  
pp. 224-238 ◽  
Author(s):  
Sergiu Gherghina ◽  
Brigitte Geissel

Extensive scholarly attention is devoted to citizens’ preferences for alternative models of political decision-making. However, few efforts were made to identify who these citizens are and why they display a certain preference. To address this void in the literature, our article analyzes the determinants of preferences for citizens as decision-makers. It uses individual-level data from a 2014 survey on a probability representative sample in Germany and tests the effects of political attitudes toward institutions of representative democracy, interest in politics, and civic involvement. It controls for consumption of political news, education, and age.


2020 ◽  
Vol 39 (3) ◽  
pp. 4041-4058
Author(s):  
Fang Liu ◽  
Xu Tan ◽  
Hui Yang ◽  
Hui Zhao

Intuitionistic fuzzy preference relations (IFPRs) have the natural ability to reflect the positive, the negative and the non-determinative judgements of decision makers. A decision making model is proposed by considering the inherent property of IFPRs in this study, where the main novelty comes with the introduction of the concept of additive approximate consistency. First, the consistency definitions of IFPRs are reviewed and the underlying ideas are analyzed. Second, by considering the allocation of the non-determinacy degree of decision makers’ opinions, the novel concept of approximate consistency for IFPRs is proposed. Then the additive approximate consistency of IFPRs is defined and the properties are studied. Third, the priorities of alternatives are derived from IFPRs with additive approximate consistency by considering the effects of the permutations of alternatives and the allocation of the non-determinacy degree. The rankings of alternatives based on real, interval and intuitionistic fuzzy weights are investigated, respectively. Finally, some comparisons are reported by carrying out numerical examples to show the novelty and advantage of the proposed model. It is found that the proposed model can offer various decision schemes due to the allocation of the non-determinacy degree of IFPRs.


2019 ◽  
Author(s):  
Suci Handayani Handayani ◽  
Hade Afriansyah

Decision making is one element of economic value, especially in the era of globalization, and if it is not acceptable in the decision making process, we will be left behind. According to Robins, (2003: 173), Salusu, (2000: 47), and Razik and Swanson, (1995: 476) say that decision making can be interpreted as a process of choosing a number of alternatives, how to act in accordance with concepts, or rules in solving problems to achieve individual or group goals that have been formulated using a number of specific techniques, approaches and methods and achieve optimal levels of acceptance.Decision making in organizations whether a decision is made for a person or group, the nature of the decision is often determined by rules, policies, prescribed, instructions that have been derived or practices that apply. To understand decision making within the organization it is useful to view decision making as part of the overall administrative process. In general, individuals tend to use simple strategies, even if in any complex matter, to get the desired solution, because the solution is limited by imperfect information, time and costs, limited thinking and psychological stress experienced by decision makers.


2020 ◽  
Author(s):  
Medha Shekhar ◽  
Dobromir Rahnev

Humans have the metacognitive ability to judge the accuracy of their own decisions via confidence ratings. A substantial body of research has demonstrated that human metacognition is fallible but it remains unclear how metacognitive inefficiency should be incorporated into a mechanistic model of confidence generation. Here we show that, contrary to what is typically assumed, metacognitive inefficiency depends on the level of confidence. We found that, across five different datasets and four different measures of metacognition, metacognitive ability decreased with higher confidence ratings. To understand the nature of this effect, we collected a large dataset of 20 subjects completing 2,800 trials each and providing confidence ratings on a continuous scale. The results demonstrated a robustly nonlinear zROC curve with downward curvature, despite a decades-old assumption of linearity. This pattern of results was reproduced by a new mechanistic model of confidence generation, which assumes the existence of lognormally-distributed metacognitive noise. The model outperformed competing models either lacking metacognitive noise altogether or featuring Gaussian metacognitive noise. Further, the model could generate a measure of metacognitive ability which was independent of confidence levels. These findings establish an empirically-validated model of confidence generation, have significant implications about measures of metacognitive ability, and begin to reveal the underlying nature of metacognitive inefficiency.


2017 ◽  
Vol 65 (4) ◽  

Within a clinical sports medical setting the discussion about doping is insufficient. In elite-sports use of pharmaceutical agents is daily business in order to maintain the expected top-level performance. Unfortunately, a similar development could be observed in the general population of leisure athletes where medical supervision is absent. As a sports physician you are facing imminent ethical questions when standing in between. Therefore, we propose the application of a standardised risk score as a tool to promote doping-prevention and launch the debate within athlete-physician-relationship. In the longterm such kind of risk stratification systems may support decision-making with regard to «protective» exclusion of sporting competition.


2015 ◽  
Vol 4 (1and2) ◽  
Author(s):  
Rajeev Dhingra ◽  
Preetvanti Singh

Decision problems are usually complex and involve evaluation of several conflicting criteria (parameters). Multi Criteria Decision Making (MCDM) is a promising field that considers the parallel influence of all criteria and aims at helping decision makers in expressing their preferences, over a set of predefined alternatives, on the basis of criteria (parameters) that are contradictory in nature. The Analytic Hierarchy Process (AHP) is a useful and widespread MCDM tool for solving such type of problems, as it allows the incorporation of conflicting objectives and decision makers preferences in the decision making. The AHP utilizes the concept of pair wise comparison to find the order of criteria (parameters) and alternatives. The comparison in a pairwise manner becomes quite tedious and complex for problems having eight alternatives or more, thereby, limiting the application of AHP. This paper presents a soft hierarchical process approach based on soft set decision making which eliminates the least promising candidate alternatives and selects the optimum(potential) ones that results in the significant reduction in the number of pairwise comparisons necessary for the selection of the best alternative using AHP, giving the approach a more realistic view. A supplier selection problem is used to illustrate the proposed approach.


Axioms ◽  
2021 ◽  
Vol 10 (2) ◽  
pp. 124
Author(s):  
Dragiša Stanujkić ◽  
Darjan Karabašević ◽  
Gabrijela Popović ◽  
Predrag S. Stanimirović ◽  
Florentin Smarandache ◽  
...  

Some decision-making problems, i.e., multi-criteria decision analysis (MCDA) problems, require taking into account the attitudes of a large number of decision-makers and/or respondents. Therefore, an approach to the transformation of crisp ratings, collected from respondents, in grey interval numbers form based on the median of collected scores, i.e., ratings, is considered in this article. In this way, the simplicity of collecting respondents’ attitudes using crisp values, i.e., by applying some form of Likert scale, is combined with the advantages that can be achieved by using grey interval numbers. In this way, a grey extension of MCDA methods is obtained. The application of the proposed approach was considered in the example of evaluating the websites of tourism organizations by using several MCDA methods. Additionally, an analysis of the application of the proposed approach in the case of a large number of respondents, done in Python, is presented. The advantages of the proposed method, as well as its possible limitations, are summarized.


Sign in / Sign up

Export Citation Format

Share Document