scholarly journals Patients’ views on the implementation of artificial intelligence in radiology: development and validation of a standardized questionnaire

2019 ◽  
Vol 30 (2) ◽  
pp. 1033-1040 ◽  
Author(s):  
Yfke P. Ongena ◽  
Marieke Haan ◽  
Derya Yakar ◽  
Thomas C. Kwee

Abstract Objectives The patients’ view on the implementation of artificial intelligence (AI) in radiology is still mainly unexplored territory. The aim of this article is to develop and validate a standardized patient questionnaire on the implementation of AI in radiology. Methods Six domains derived from a previous qualitative study were used to develop a questionnaire, and cognitive interviews were used as pretest method. One hundred fifty-five patients scheduled for CT, MRI, and/or conventional radiography filled out the questionnaire. To find underlying latent variables, we used exploratory factor analysis with principal axis factoring and oblique promax rotation. Internal consistency of the factors was measured with Cronbach’s alpha and composite reliability. Results The exploratory factor analysis revealed five factors on AI in radiology: (1) distrust and accountability (overall, patients were moderately negative on this subject), (2) procedural knowledge (patients generally indicated the need for their active engagement), (3) personal interaction (overall, patients preferred personal interaction), (4) efficiency (overall, patients were ambiguous on this subject), and (5) being informed (overall, scores on these items were not outspoken within this factor). Internal consistency was good for three factors (1, 2, and 3), and acceptable for two (4 and 5). Conclusions This study yielded a viable questionnaire to measure acceptance among patients of the implementation of AI in radiology. Additional data collection with confirmatory factor analysis may provide further refinement of the scale. Key Points • Although AI systems are increasingly developed, not much is known about patients’ views on AI in radiology. • Since it is important that newly developed questionnaires are adequately tested and validated, we did so for a questionnaire measuring patients’ views on AI in radiology, revealing five factors. • Successful implementation of AI in radiology requires assessment of social factors such as subjective norms towards the technology.

2021 ◽  
Vol 33 (S1) ◽  
pp. 87-88
Author(s):  
J. Antonio Garcia-Casal ◽  
Natacha Coelho de Cunha Guimarães ◽  
Sofía Díaz Mosquera ◽  
María Alvarez Ariza ◽  
Raimundo Mateos Álvarez

Background:Rowland Universal Dementia Assessment Scale (RUDAS) is a brief cognitive test, appropriate for people with minimum completed level of education and sensitive to multicultural contexts. It could be a good instrument for cognitive impairment (CI) screening in Primary Health Care (PHC). It comprises the following areas: recent memory, body orientation, praxis, executive functions and language.Research Objective:The objective of this study is to assess the construct validity of RUDAS analysing its internal consistency and factorial structure.Method:Internal consistency will be calculated using ordinal Cronbach’s α, which reflects the average inter-item correlation score and, as such, will increase when correlations between the items increase. Exploratory Factor Analysis will be used to arrange the variables in domains using principal components extraction. The factorial analysis will include the extraction of five factors reflecting the neuropsychological areas assessed by the test. The result will be rotated under Varimax procedure to ease interpretation.Exploratory factor analysis will be used to arrange the variables in domains using principal components extraction. The analysis will include Kaiser–Meyer–Olkin measure of sampling adequacy and Bartlett’s test of sphericity. Estimations will be based based on Pearson’s correlations between indicators using a principal component analysis and later replicated with a tetrachoric correlation matrix. The variance in the tetrachoric model will be analysed to indentify convergent iterations and their explicative power.Preliminary results of the ongoing study:RUDAS is being administered to 321 participants older than 65 years, from seven PHC physicians’ consultations in O Grove Health Center. The data collection will be finished by August 2021 and in this poster we will present the final results of the exploratory factor analysis.Conclusions:We expect that the results of the exploratory factor analysis will replicate the results of previous studies of construct validity of the test in which explanatory factor weights were between 0.57 and 0.82, and all were above 40%. Confirming that RUDAS has a strong factor construct with high factor weights and variance ratio, and 6-item model is appropriate for measurement will support its recommendation as a valid screening instrument for PHC.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Amanda Harley ◽  
Luregn J. Schlapbach ◽  
Paula Lister ◽  
Debbie Massey ◽  
Patricia Gilholm ◽  
...  

Abstract Background Several health care systems internationally have implemented protocolised sepsis recognition and treatment bundles for children to improve outcomes, as recommended by the Surviving Sepsis Campaign. Successful implementation of clinical pathways is challenging and dependent on nurse engagement. There is limited data on knowledge translation during implementation of sepsis quality improvement programs. Methods This cross-sectional, multicentre observational survey study evaluated knowledge and perceptions of Emergency Department nurses in relation to the recognition, escalation and management of paediatric sepsis following implementation of a sepsis pathway. The study was conducted between September 2019 and March 2020 across 14 Emergency Departments in Queensland, Australia. The primary outcome was a sepsis knowledge score. An exploratory factor analysis was conducted to identify factors impacting nurses’ perceptions of recognition, escalation and management of paediatric sepsis and their association with knowledge. Using a logistic mixed effects model we explored associations between knowledge, identified factors and other clinical, demographic and hospital site variables. Results In total, 676 nurses responded to the survey and 534 were included in the analysis. The median knowledge score was 57.1% (IQR = 46.7–66.7), with considerable variation observed between sites. The exploratory factor analysis identified five factors contributing to paediatric sepsis recognition, escalation and management, categorised as 1) knowledge and beliefs, 2) social influences, 3) beliefs about capability and skills delivering treatment, 4) beliefs about capability and behaviour and 5) environmental context. Nurses reported strong agreement with statements measuring four of the five factors, responding lowest to the factor pertaining to capability and skills delivering treatment for paediatric sepsis. The factors knowledge and beliefs, capability and skills, and environmental context were positively associated with a higher knowledge score. Years of paediatric experience and dedicated nurse funding for the sepsis quality improvement initiative were also associated with a higher knowledge score. Conclusion Translation of evidence to practice such as successful implementation of a sepsis care bundle, relies on effective education of staff and sustained uptake of protocols in daily practice. Our survey findings identify key elements associated with enhanced knowledge including dedicated funding for hospitals to target paediatric sepsis quality improvement projects.


Author(s):  
Emine Önder ◽  
Zeynep Karatas

The aim of the study is to develop a new scale, called the “Classroom Management Anxiety Scale for Candidate Teachers”. This study was carried out on three different groups consisting of university senior class students from Mehmet Akif Ersoy University in Turkey. The psychometric properties of the Scale (CMAS-CT) were analyzed by means of item analysis, exploratory factor analysis, confirmatory factor analysis (CFA) and internal consistency and split-half methods. The exploratory factor analysis (EFA) results demonstrated that the scale comprised five factors. As a result of the EFA, the factor loadings of 25 items in the five factors were found to vary between 0.39 and 0.85. These five factors explained 54% of the total variance. CFA results demonstrated that five dimensional model provides good fit as per obtained fit index values. The Scale (CMAS-CT)’s internal consistency coefficient total scale score was determined .89 and split-half reliability coefficient was determined part 1 .85 and part 2 .79. In conclusion, Classroom Management Anxiety Scale for Candidate Teachers can be used as a reliable and valid measure for Turkish university senior class students. Keywords: Classroom management, anxiety, classroom management anxiety, candidate teacher


2020 ◽  
Vol 34 (4) ◽  
pp. 869-897
Author(s):  
Atiqa Rafeh ◽  
Rubina Hanif

The present study was intended to develop a scale to measure perceived weight stigmatization among people with obesity. The study was conducted in five steps. In first step, three focus group discussions were conducted with female obese university students to get the first-hand information related to weight stigmatization. Step two involved four interviews which were conducted with male obese university students to collect detailed information about weight stigmatization experiences of men. Step three included content analysis of qualitative data for item generation. In step four, judge’s opinion was taken, and a committee approach was carried out to select the items for the initial form of the scale. Items for final form of the scale were selected through exploratory factor analysis and confirmatory factor analysis in step five. For exploratory factor analysis, 150 university students (men = 61, women = 89) were included in the sample, whereas, for confirmatory factor analysis, another group of students (men = 78, women = 72) participated in the study. Principal Component Factor Analysis revealed three meaningful structures including Self-Perception, Perceived Social Rejection, and Perceived Impact containing 43 items. Confirmatory factor analysis confirmed this factor structure and all 43 items possessed factor loadings greater than .40. Moreover, results indicated that perceived weight stigmatization had high internal consistency (Cronbach’s alpha = .96) with three subscales having internal consistency .95, .83, and .92 respectively. Therefore, Perceived Weight Stigmatization Scale turned out to be a reliable and valid instrument for measuring perception of weight stigma in adults with obesity.


Author(s):  
Mihwa Han ◽  
Kyunghee Lee ◽  
Mijung Kim ◽  
Youngjin Heo ◽  
Hyunseok Choi

Metacognition is a higher-level cognition of identifying one’s own mental status, beliefs, and intentions. This research comprised a survey of 184 people with schizophrenia to verify the reliability of the metacognitive rating scale (MCRS) with the revised and supplemented metacognitions questionnaire (MCQ) to measure the dysfunctional metacognitive beliefs of people with schizophrenia by adding the concepts of anger and anxiety. This study analyzed the data using principal component analysis and the varimax method for exploratory factor analysis. To examine the reliability of the extracted factors, Cronbach’s α was used. According to the results, reliability was ensured for five factors: positive beliefs about worry, negative beliefs about uncontrollability and danger of worry, cognitive confidence, need for control, and cognitive self-consciousness. The negative beliefs about uncontrollability and danger of worry and the need for control on anger expression, which were both added in this research, exhibited the highest correlation (r = 0.727). The results suggest that the MCRS is a reliable tool to measure the metacognition of people with schizophrenia.


2021 ◽  
Vol 9 (1) ◽  
Author(s):  
Rebecca Horn ◽  
Kanykey Jailobaeva ◽  
Stella Arakelyan ◽  
Alastair Ager

Abstract Background Studies of psychological distress in Sierra Leone have typically used measures which were developed for use in other contexts, and which often have not been adapted or validated for use in Sierra Leone. This has resulted in a lack of reliable information about the patterns of psychological distress within the population, which is a barrier to the development of effective and appropriate mental health services. The aim of the study was to develop a locally-appropriate measure of psychological distress for Sierra Leone. Methods The new measure consists of two instruments: the Sierra Leone Psychological Distress Scale (SLPDS) and a gendered measure of ability to carry out daily tasks—a Function scale—as an indication of the severity of distress. A three-phase mixed methods exploratory sequential study was conducted. Phase 1 was item generation and testing, leading to the development of a set of potential items for both instruments. Phase 2 was a small pilot study (N = 202) leading to the selection of the final set of items for both measures. Phase 3 was a validation phase where the SLPDS and the Function scale were administered with a larger sample of 904 respondents. Item analysis was used to assess the internal consistency of the scales, and Exploratory Factor Analysis to explore the properties of the SLPDS. Results Exploratory factor analysis using the principal axis factoring with an oblique rotation identified a three-factor structure for the 18-item SLPDS. Internal consistency for the SLPDS (Cronbach’s alpha = 0.89) and three subscales was good (Cronbach’s alpha > 0.73). The internal reliability of the male and female versions of the Function scale was also found to be acceptable (Cronbach’s alpha = 0.90 for the female scale and 0.79 for the male scale). Conclusions Together the SLPD and Function scales provide a locally-validated tool which will enable government bodies and local and international non-governmental organisations in Sierra Leone to assess mental health and psychosocial needs. This will support both effective service provision and the evaluation of initiatives designed to improve mental health and psychosocial wellbeing.


2021 ◽  
Vol 36 (6) ◽  
pp. 1251-1251
Author(s):  
Anthony J Longoria ◽  
Ben K Mokhtari ◽  
Tawny Meredith-Duliba ◽  
Mary A Hershberger ◽  
Patricia Champagne ◽  
...  

Abstract Objective Self-report scales are commonly used to evaluate non-specific symptoms following concussion. While several scales have been developed, few were created using a systematic process and most contain several ambiguous items that may be misinterpreted. To address this, a new theoretically-based, multidimensional measure was designed to assess Cognitive, Neuropsychiatric, and Somatic symptoms associated with concussion. This study used sophisticated psychometric techniques to develop the Texas Postconcussion Symptom Inventory (TPSI) and establish initial reliability and validity. Method Because concussion symptoms are non-specific, a pool of 76 potential items was developed and administered to a diverse clinical sample (N = 350) that included patients with concussion, epilepsy, and dementia. Polychoric correlations were utilized to remove items based on poor fit/multicollinearity and an exploratory factor analysis (EFA) with an Oblimin rotation was used to determine factor structure. Results A three-factor model best fit the data, and represented Cognitive, Neuropsychiatric, and Somatic domains as designed. Ten items were discarded, resulting in a total of 66 items. The model explained 48.5% of the total variance and contained adequate sampling (Kaiser-Meyer-Olkin measure =0.92) and sufficient item correlations (Bartlett’s Test of Sphericity, p < 0.05) for EFA. All three factor structures displayed high internal consistency (Cronbach’s α > 0.88). Conclusions The TPSI is a brief, multidimensional measure with evidence of strong internal consistency and reliability as well as distinct Cognitive, Neuropsychiatric, and Somatic symptoms associated with concussion. Future research will investigate its convergent and divergent validity in concussion as compared to existing popular symptom measures.


2020 ◽  
Vol 18 (1) ◽  
Author(s):  
Feifei Zhou ◽  
Shuyang Li ◽  
Yilong Zhang ◽  
Yanbin Zhao ◽  
Kevin L. Ju ◽  
...  

Abstract Background The aim of this study is to investigate the reliability, validity, and responsiveness of JOACMEQ for CSM patients in mainland China. Methods A retrospective review was performed on 91 patients with CSM in our hospital from March 2015 to June 2015. Patients completed the JOACMEQ, the mJOA and the SF-36 questionnaires during the process. Cronbach's α was used to evaluate the internal consistency reliability, and test–retest reliability was checked. An exploratory factor analysis was used to determine the correlations among the JOACMEQ questions and the construct validity. The concurrent validity was assessed by Spearman correlation coefficient. The internal responsiveness was determined by effect sizes and standardized response means. External responsiveness was determined by the area under the receiver operating characteristic curve on the basis of the Youden Index. Results The mean age of patients was 57.61 years old. The mean follow-up was 24 months. JOACMEQ showed a good internal consistency (Cronbach's α, 0.897). Test–retest reliability showing good result (Pearson's correlation, 0.695–0.905). Our data were amenable to factor analysis (KMO = 0.816, Bartlett's test, χ2(45) = 1199.99, p < 0.001), and five factors above 1 were strongly loaded and clustered for each of the five factors. Comparing the scales preoperative to those 2 years postoperative, the average scores of the subscales all increased, and both the ES and SRM showing satisfied responsiveness. In external responsiveness analysis, the recovery rate a appeared to be most responsive to post-operative improvement. Conclusions The Simplified Chinese version of JOACMEQ was well-developed with great reliability and sensitive responsiveness. Our study demonstrated that JOACMEQ has content psychometric properties to identify postoperative improvements in CSM patients.


2016 ◽  
Vol 2 (1) ◽  
pp. 1 ◽  
Author(s):  
Mohsin Abbas ◽  
Adel M. Zakaria ◽  
Mansour A. Balkhyour ◽  
Muhammad Kashif

<p class="1"><span lang="EN-US">Academic laboratories considered as more hazardous than industry due to relaxed approach of academic management for chemical safety. This study designed to analyze the safe work practices and facilities by Exploratory Factor Analysis (EFA) using Varimax rotation. A designed checklist of 26 safety items administered personally in 68 academic laboratories in a Saudi university. From EFA, five factors were extracted: “Availability of laboratory safety documents (5 items, α = 0.92)”, “Maintenance of fume hood (2 items, α = 0.75)”, “Proper chemical storage (3 items, α = 0.64)”, “Proper use of fume hood for chemical handling (4 items, α = 0.62)” and “Laboratory safety labelling (2 items, α = 0.73)”. The results revealed the 5 factors model that grouped 16 safety items that may be crucial for chemical storage, fume hood, laboratory safety plans and labels in the academic laboratories. The extracted factors derived from EFA are expected to help in the development of chemical safety management in the academic laboratories. </span></p>


2016 ◽  
Vol 34 (5) ◽  
pp. 435-441 ◽  
Author(s):  
Kristin R. Baughman ◽  
Ruth Ludwick ◽  
Rebecca Fischbein ◽  
Kenelm McCormick ◽  
James Meeker ◽  
...  

Background: Although patients prefer that physicians initiate advance care planning (ACP) conversations, few physicians regularly do so. Physicians may be reluctant to initiate ACP conversations because they lack self-efficacy in their skills. Yet, no validated scale on self-efficacy for ACP exists. Our objective was to develop a scale that measures physicians’ ACP self-efficacy (ACP-SE) and to investigate the validity of the tool. Methods: Electronic questionnaires were administered to a random sample of family medicine physicians (n = 188). Exploratory factor analysis was performed to determine whether the scale was multidimensional. An initial assessment of the scale’s validity was also conducted. Results: The exploratory factor analysis indicated that a single factor was appropriate using all 17 items. A single, unidimensional scale was created by averaging the 17 items, yielding good internal consistency (Cronbach α = 0.95). The average scale score was 3.94 (standard deviation = 0.71) on a scale from 1 to 5. The scale was moderately correlated with a global single-item measure of self-efficacy for ACP ( r = .79, P < .001), and the scale differentiated between physician groups based on how much ACP they were doing, how recently they had an ACP conversation, formal training on ACP, and knowledge of ACP. In a multivariate analysis, the ACP-SE scale was a strong predictor of the percentage of patients with chronic life-limiting diseases with whom the physician discussed ACP. Conclusion: The final ACP-SE scale included 17 items and demonstrated high internal consistency.


Sign in / Sign up

Export Citation Format

Share Document