scholarly journals Use of a quantitative data report in a hypothetical decision scenario for health policymaking: a computer-assisted laboratory study

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Pamela Wronski ◽  
Michel Wensing ◽  
Sucheta Ghosh ◽  
Lukas Gärttner ◽  
Wolfgang Müller ◽  
...  

Abstract Background Quantitative data reports are widely produced to inform health policy decisions. Policymakers are expected to critically assess provided information in order to incorporate the best available evidence into the decision-making process. Many other factors are known to influence this process, but little is known about how quantitative data reports are actually read. We explored the reading behavior of (future) health policy decision-makers, using innovative methods. Methods We conducted a computer-assisted laboratory study, involving starting and advanced students in medicine and health sciences, and professionals as participants. They read a quantitative data report to inform a decision on the use of resources for long-term care in dementia in a hypothetical decision scenario. Data were collected through eye-tracking, questionnaires, and a brief interview. Eye-tracking data were used to generate ‘heatmaps’ and five measures of reading behavior. The questionnaires provided participants’ perceptions of understandability and helpfulness as well as individual characteristics. Interviews documented reasons for attention to specific report sections. The quantitative analysis was largely descriptive, complemented by Pearson correlations. Interviews were analyzed by qualitative content analysis. Results In total, 46 individuals participated [students (85%), professionals (15%)]. Eye-tracking observations showed that the participants spent equal time and attention for most parts of the presented report, but were less focused when reading the methods section. The qualitative content analysis identified 29 reasons for attention to a report section related to four topics. Eye-tracking measures were largely unrelated to participants’ perceptions of understandability and helpfulness of the report. Conclusions Eye-tracking data added information on reading behaviors that were not captured by questionnaires or interviews with health decision-makers.

2021 ◽  
Author(s):  
Jan Koetsenruijter ◽  
Pamela Wronski ◽  
Sucheta Ghosh ◽  
Wolfgang Müller ◽  
Michel Wensing

BACKGROUND Although decision-makers in healthcare settings need to read and understand the validity of quantitative reports, information of research methods is not always well read. Presenting the methods in a structured way could improve the reading and perceived relevance for this important report section. OBJECTIVE To test the effect of a structured summary of methods used in a quantitative data report on reading behaviour and perceived importance by using computer-assisted eye-tracking. METHODS A nonrandomized pilot trial was performed in a computer laboratory setting with advanced medical students. They were asked to read a quantitative data report and the intervention arm was additionally offered a box with the key features of the methods used. Three data-collection methods were used to document reading behaviours and views of participants: eye-tracking during reading, written questionnaires, and face-to-face interviews. RESULTS We included 35 participants, 22 in the control arm and 13 in the intervention. The overall reading time of the methods was not different between the two study arms. The intervention arm found the information on methods less helpful for the decision than the control arm (4,09 versus 2,92). Participants who read the box more intensively tended to spent more time on the methods as a whole (Pearson correlation 0.81, P=.001). CONCLUSIONS We found no indication that adding a structured summary of information on research methods used had increased the time spent on reading the methods. However, it resulted in a lower appreciation of the helpfulness of the information on methods. Future studies should focus on other methods to improve the attention for the methods used in in quantitative reports. CLINICALTRIAL No clinical trial was performed.


This article examines real events, their perceptions and narratives concerned with the key actors in the Donbas crisis – Ukraine, the EU/EU member states, Russia and the USA. Perceptions and narratives are traced in the texts of interviews with Ukrainian policy- and decision-makers from political, business, cultural, and civic cohorts (40 respondents). The elites were interviewed in the winter of 2016 within the framework of the Jean Monnet Network “Crisis, conflict and critical diplomacy: EU perceptions in Ukraine and Israel/Palestine” (C3EU), supported by Earsmus+ program of the European Commission. Informed by the strategic narrative theory [Miskimmon et al. 2013], the article undertakes a qualitative content analysis of the interview texts, explicating elite perceptions of the crisis in Donbas. The results spell the need for a more nuanced understanding of Ukraine’s perceptions of key actors in the ongoing conflict as well as the origin of these perceptions. Arguably, such understanding may benefit the EU’s critical diplomacy towards Ukraine and add a valuable insight to the constructive dialogue between Ukraine and the EU.


Author(s):  
Gianpaolo Zammarchi ◽  
Giulia Contu ◽  
Luca Frigau

Every tourist website employs images to attract potential tourists. In particular, destination tourism websites use environmental images, such as landscapes, to attract the attention of tourists and to address their purchase choice. Nowadays the effectiveness of these tools has been enhanced by the use of eye-tracking technology. That allows measuring the exact eye position during the visualization of images, texts, or other visual stimuli. Consequently, eye-tracking data can be processed to obtain quantitative measures of viewing behavior that can be analyzed for several purposes in many fields such as to cluster consumers, to improve the effectiveness of a website and for neuroscience studies. This work is aimed to use eye-tracking technology to investigate user behavior according to different types of images (e.g. natural landscapes, city landscapes). Specifically, we compare different statistical descriptive tools with supervised and unsupervised models. Furthermore, we discuss the effectiveness of their results and their capacity to provide satisfactory and interpretable solutions that can be used by decision-makers.


Author(s):  
Danielle Hughes ◽  
Emma Colvin ◽  
Isabelle Bartkowiak-Théron

Since bail legislation was enacted in the 1970s, Australia has experienced a continual increase in the number of prisoners on remand. Amendments to bail legislation and police discretion have been shown to contribute to this increase. Further, an accused’s vulnerability affects whether they are granted or denied bail, with vulnerable people being more likely to be denied bail. Vulnerability in the criminal justice system refers to factors such as race, age, sex and socioeconomic status. Many vulnerable people have multiple intersecting vulnerabilities, which further compounds their contact with the justice system. This study employed a qualitative content analysis of bail legislation for the Australian states of New South Wales (NSW), Tasmania, and Victoria, along with key correlating second reading speeches. The aim was to better understand the way in which bail decision-makers, such as police, consider vulnerability when making decisions about bail, in particular, if and how they are legislated to consider factors relating to vulnerability. The research found that only police in NSW and Victoria were required to consider an accused’s vulnerability explicitly under the law. Although legislation may cater for varying vulnerabilities, intersecting vulnerabilities are not considered.


2012 ◽  
Author(s):  
Melanie E. Brewster ◽  
Esther N. Tebbe ◽  
Brandon L. Velez

2020 ◽  
Author(s):  
Kun Sun

Expectations or predictions about upcoming content play an important role during language comprehension and processing. One important aspect of recent studies of language comprehension and processing concerns the estimation of the upcoming words in a sentence or discourse. Many studies have used eye-tracking data to explore computational and cognitive models for contextual word predictions and word processing. Eye-tracking data has previously been widely explored with a view to investigating the factors that influence word prediction. However, these studies are problematic on several levels, including the stimuli, corpora, statistical tools they applied. Although various computational models have been proposed for simulating contextual word predictions, past studies usually preferred to use a single computational model. The disadvantage of this is that it often cannot give an adequate account of cognitive processing in language comprehension. To avoid these problems, this study draws upon a massive natural and coherent discourse as stimuli in collecting the data on reading time. This study trains two state-of-art computational models (surprisal and semantic (dis)similarity from word vectors by linear discriminative learning (LDL)), measuring knowledge of both the syntagmatic and paradigmatic structure of language. We develop a `dynamic approach' to compute semantic (dis)similarity. It is the first time that these two computational models have been merged. Models are evaluated using advanced statistical methods. Meanwhile, in order to test the efficiency of our approach, one recently developed cosine method of computing semantic (dis)similarity based on word vectors data adopted is used to compare with our `dynamic' approach. The two computational and fixed-effect statistical models can be used to cross-verify the findings, thus ensuring that the result is reliable. All results support that surprisal and semantic similarity are opposed in the prediction of the reading time of words although both can make good predictions. Additionally, our `dynamic' approach performs better than the popular cosine method. The findings of this study are therefore of significance with regard to acquiring a better understanding how humans process words in a real-world context and how they make predictions in language cognition and processing.


Sign in / Sign up

Export Citation Format

Share Document