scholarly journals Design and Psychometric Evaluation of User Satisfaction Questionnaire in Integrated Health System for Reliability and Validity

2021 ◽  
Vol 12 (2) ◽  
pp. 187-199
Author(s):  
Jamileh Abolghasemi ◽  
Zeinab Mohammadzadeh ◽  
Elham Maserat ◽  
Reza Kariminezhad
Keyword(s):  
Health System ◽  
User Satisfaction ◽  
System Performance ◽  
Assessment Tool ◽  
Ease Of Use ◽  
Face Validity ◽  
Satisfaction Questionnaire ◽  
Total Satisfaction ◽  
Integrated Health ◽  
Over Time

Background and Objectives: Evaluating the effectiveness of health information systems and users' satisfaction with system performance is important. The success of an information system is directly dependent on the system responding to user needs. Due to the importance of this issue, a tool has been designed to evaluate users' satisfaction with Integrated Health System. Material and Methods: This cross-sectional study was conducted in 2018 to design a questionnaire to assess the users' satisfaction with Integrated Health System. In the first step, the areas of user satisfaction were identified by reviewing literature and reliable scientific sources. Then a bank of questions was created and after classifying the indicators and identifying related questions the primary tool was developed in several areas. Face validity and content validity of the questionnaire were determined using CVI and CVR indices. Reliability over time was assessed by 20 users of in an Integrated Health System with two-week intervals. Results: The final questionnaire included demographic information and 55 questions about the components of a System Satisfaction Questionnaire. Questions related to each component included system interface, system functions, system performance, system information and statistics, system supportive services, System services, and and total satisfaction from the system. The average CVI and CVR for total questions were 0.84 and 0.73, respectively. For reliability over time, the coefficient (ICC) for the whole structure was 0.98. The reliability of the questionnaire evaluated by Cronbach's alpha and internal consistency method, that this value was obtained 0.914 for total questionnaire. Also, separately for each structure was obtained in the "good" range. Conclusion: In this study, we tried to provide a brief and expressive user satisfaction assessment tool that required the least amount of time to respond. The high response rate of all questions indicates that designed tool achieved the objectives of the study. The most emphasized component by users is the system support component. Ease of use of the system, usefulness and support of the system from performing daily activities are other things that are more important for users.

scholarly journals Effectiveness of Integrated Health Systems in Africa: A Systematic Review

Medicina ◽  
2020 ◽  
Vol 56 (6) ◽  
pp. 271
Author(s):  
Irene G. Ampomah ◽  
Bunmi S. Malau-Aduli ◽  
Aduli E.O. Malau-Aduli ◽  
Theophilus I. Emeto
Keyword(s):  
Health System ◽  
Quality Assessment ◽  
Health Systems ◽  
Assessment Tool ◽  
Integrated System ◽  
Health Policies ◽  
Orthodox Medicine ◽  
Ovid Medline ◽  
Integrated Health ◽  
Critical Appraisal Tool

Background and objective: Traditional medicine (TM) was integrated into health systems in Africa due to its importance within the health delivery setup in fostering increased health care accessibility through safe practices. However, the quality of integrated health systems in Africa has not been assessed since its implementation. The objective of this paper was to extensively and systematically review the effectiveness of integrated health systems in Africa. Materials and Methods: A systematic literature search was conducted from October, 2019 to March, 2020 using Ovid Medline, Scopus, Emcare, Web of Science, Cumulative Index to Nursing and Allied Health (CINAHL), and Google Scholar, in order to retrieve original articles evaluating the integration of TM into health systems in Africa. A quality assessment of relevant articles was also carried out using the Quality Assessment Tool for Studies with Diverse Designs (QATDSS) critical appraisal tool. Results: The results indicated that the formulation and execution of health policies were the main measures taken to integrate TM into health systems in Africa. The review also highlighted relatively low levels of awareness, usage, satisfaction, and acceptance of integrated health systems among the populace. Knowledge about the existence of an integrated system varied among study participants, while satisfaction and acceptance were low among orthodox medicine practitioners. Health service users’ satisfaction and acceptance of the practice of an integrated health system were high in the countries assessed. Conclusion: The review concluded that existing health policies in Africa are not working, so the integration of TM has not been successful. It is critical to uncover the barriers in the health system by exploring the perceptions and experiences of stakeholders, in order to develop solutions for better integration of the two health systems.

scholarly journals Testing the framework in real life – application for country HSPA process

2020 ◽  
Vol 30 (Supplement_5) ◽  
Author(s):  
T Lai
Keyword(s):  
Health System ◽  
Performance Assessment ◽  
System Performance ◽  
Real Life ◽  
Ease Of Use ◽  
Assessment Tools ◽  
Assessment Process ◽  
Health System Performance ◽  
Health System Performance Assessment ◽  
System Assessment

Abstract The ability to use the existing health system assessment tools, HSPA processes and widely available indicators is an important, although not exhaustive, part of the practical application of the framework. With this in mind, we created an annotated template that can be used along with HSPA framework for UHC to facilitate information collection and harmonisation. This annotated template was tested for Estonia and Azerbaijan with the aim to help with evaluating the transferability of HSPA information between existing approaches and in different settings. More specifically, we tested the extent to which information on assessment areas of the framework can be extracted from the existing sources; the ease of use and clarity of the annotated template; and how the information collected through the annotated template can be combined into a meaningful health system performance assessment, in line with health system goals. The test showed that the information for Estonia and Azerbaijan could be obtained to complete much of the template. This can be done through a country-led performance assessment process that ensures that the indicative measures in the annotated template are relevant to the country context. The information collected also needs to be assessed in the context of policy priorities of the national health systems. Thus, more detailed guidance on the use of the framework can help to streamline such national processes and clarify the linkages between performance of specific functions and overall health system performance.

Pharmacist Perception of a Mobile Application Audience Response System for Remote Pharmacy Continuing Education Participants

2018 ◽  
Vol 33 (2) ◽  
pp. 153-157 ◽  
Author(s):  
Peter G. Koval ◽  
Jennifer J. Kim ◽  
Tanya Makhlouf
Keyword(s):  
Health System ◽  
Continuing Education ◽  
Mobile Application ◽  
Online Survey ◽  
Assessment Tool ◽  
Pharmacy Practice ◽  
Ease Of Use ◽  
Audience Response System ◽  
Audience Response ◽  
Response System

Introduction: Interactive audience response during continuing education (CE) in pharmacy practice increases audience involvement. However, remote-site participants may not have access to interactive technology. This study explores the perceptions of a mobile application audience response system (ARS) by remote pharmacy CE participants. Secondarily, we evaluatedinterest in continued use of ARS, as well as willingness to use as an assessment tool for CE effectiveness. Methods: Pharmacists participating in CE sessions remotely within a health system were provided a unique ARS session code to enter into a free mobile application. Participants then responded to ARS presentation questions. An online survey link was e-mailed to all potential remote participants inquiring about perceptions of ARS use. Results: Of the 52 potential remote users, 28 (53.8%) responded to the survey. The top 3 positive responses included the availability of free software (71.4%), anonymity (57.1%), and ease of use (53.6%). Top 2 barriers included slowing the process down (14.3%) and requiring the use of application software (14.3%). Discussion: Interactive software during pharmacy CE lectures for participants at remote locations within a health system was well accepted. ARS should be considered and further studied for CE lectures at institutions with remote participants.

Seven Factors in Evaluating Recommender System

2014 ◽  
Vol 472 ◽  
pp. 443-449
Author(s):  
Li Ting Kang ◽  
Yong Wang
Keyword(s):  
Recommender System ◽  
User Satisfaction ◽  
Assessment Tool ◽  
Evaluation Model ◽  
Ease Of Use ◽  
Evaluation Framework ◽  
Future Research ◽  
Expert Assessment ◽  
Perceived Ease Of Use ◽  
Theoretical Evaluation

Recommender system (RS) has been evaluated in many but incomparable ways beyond accuracy and thus proposing an evaluation framework to synthesize the existing strategies seems a solution. However, few scholars did it so far. Through literature review, user interview and expert assessment, this study proposed a theoretical evaluation model of RS and then formed the assessment tool, RS Evaluation Questionnaire (RSE). The results showed that RSE was an effective tool to evaluate a recommender system, with its reliability (Cronbachs α=0.803) and validity meeting the requirements of psychometrics. Seven factors such as Perceived Quality and Perceived Ease of Use were generated by factor analysis, accounting for 63.126% of the variance. Furthermore, regression analysis indicated that different combinations of RSE factors could significantly predict User Satisfaction, Reuse Intention and positive Word-Of-Mouth (WOM) spreading willingness. Enlightenments for future research and practice were discussed as well in the end.

scholarly journals Evaluation of the Satisfaction of Users of Weather Forecast Systems with the Service Quality Method

SinkrOn ◽  
2020 ◽  
Vol 4 (2) ◽  
pp. 130
Author(s):  
Eva Rianti ◽  
Syafrika Deni Rizky ◽  
Fariz Haris Nugraha
Keyword(s):  
Service Quality ◽  
User Satisfaction ◽  
System Performance ◽  
Weather Forecasting ◽  
Weather Forecast ◽  
Forecast System ◽  
System User ◽  
Time Evaluation ◽  
Over Time

This research was conducted to test the user's satisfaction of the weather forecast system that had been previously applied to the Teluk Bayur BMKG. The weather forecasting service at the Padang Bayur Padang BMKG has basically fulfilled the objectives of the company. However, over time, evaluation is needed so that the effectiveness of the use of the system can be known, so the system can continue to be developed. To overcome these problems, it is necessary to evaluate the performance of the system. One way is to measure user satisfaction by using Service Quality. This method is one of the techniques used to measure the level of user satisfaction with the system. Based on the results of the measurement of the quality of the weather forecast system, the results are obtained that the system user is satisfied with the system performance, but there are several indicators on the system whose performance is not fully maximized, so that there needs to be improvements and improvements of the system performance.

scholarly journals Evaluating health performance and inequalities in the Italian region of Marche

2019 ◽  
Vol 25 (9) ◽  
pp. 293-302
Author(s):  
Alberto Franci ◽  
Pietro Renzi ◽  
Rob Gandy
Keyword(s):  
Health System ◽  
Performance Assessment ◽  
System Performance ◽  
Assessment Tool ◽  
Health Indicators ◽  
Data Availability ◽  
Local Health Authority ◽  
Local Health ◽  
Health System Performance ◽  
Health System Performance Assessment

A worldwide selection of models that are used to measure health service performance were appraised. The internationally recognised Health System Performance Assessment tool was chosen for testing in a local health authority in the Marche, Italy. Local, regional, national and international comparisons were also used. A complementary means of measuring health inequality involving the Concentration Index enabled a holistic evaluation of the local health environment. While the approach addressed a comprehensive range of issues, limitations with data availability were found to present genuine constraints that require future action. Nevertheless, valuable lessons were learned for policy makers, with the relationship between socioeconomic inequalities and systematic variations in health indicators highlighted. The Health System Performance Assessment tool presents the opportunity for strategic alignment in performance measurement.

scholarly journals Purposeful Design of a Survey Tool to Evaluate the Adequacy of Hospitals’ Water Sanitation and Hygiene and Allocate Responsibility for Action – from Wash FIT to Wash Fast

2019 ◽  
Author(s):  
Michuki Maina ◽  
Mathias Zosi ◽  
Grace Kimemia ◽  
Paul Mwaniki ◽  
Arabella Hayter ◽  
...  
Keyword(s):  
Health System ◽  
Assessment Tool ◽  
Healthcare Facility ◽  
Health Care Facilities ◽  
Face Validity ◽  
Infection Prevention And Control ◽  
Survey Tool ◽  
Sanitation And Hygiene ◽  
Facility Survey ◽  
Different Levels

ABSTRACTBackgroundPoor water sanitation and hygiene (WASH) in health care facilities increases hospital associated infections and results in greater use of second line antibiotics, which drives antimicrobial resistance. The existing assessment tool, Water and Sanitation for Health Facility Improvement Tool (WASH FIT), is designed for self-assessment in smaller primary facilities. A tool is needed for larger facilities with multiple inpatient units, that supports comparison of multiple facilities and identifies who is responsible for action at different levels of the health system.MethodsWe adapted the WASH FIT tool to: 1) create a simple numeric scoring approach to enable comparison of hospitals and facilitate tracking of WASH performance over time; (2) identify indicators that can be assessed and scored for each hospital ward to help identify variation within facilities and; (3) identify those responsible to effect positive change at different levels of the health system. We used a pilot, analysis of interview data and consultative stakeholder meetings to establish the feasibility and face validity of the WASH Facility Survey Tool (WASH FAST).ResultsWASH FAST can be used to produce an aggregate percentage score at facility level to summarise hospitals’ overall WASH status and illustrate variation across hospitals. Thirty-four of the 65 indicators spanning four WASH domains can be assessed at ward level enabling between ward variations to be highlighted. Three levels of responsibility for WASH service monitoring and improvement were identified that were supported by qualitative data and multiple stakeholders: the county/regional level, hospital senior management and the infection prevention and control committee within the healthcare facility.ConclusionWe propose WASH FAST can be used as a survey tool to assess, improve and monitor progress of WASH and IPC in hospitals in resource-limited settings, providing useful data for decision making and contributing to wider quality improvement efforts.

Developing a performance matrix for multidisciplinary teams.

2020 ◽  
Vol 38 (15_suppl) ◽  
pp. e19200-e19200
Author(s):  
Lynleigh Evans ◽  
Yiren Liu ◽  
Terence Kwan ◽  
James Callister ◽  
Karen Byth ◽  
...  
Keyword(s):  
Discriminant Validity ◽  
Assessment Tool ◽  
Standard Of Care ◽  
Ease Of Use ◽  
Multidisciplinary Teams ◽  
Card Sorting ◽  
Allied Health Professionals ◽  
Performance Matrix ◽  
The Matrix ◽  
Over Time

e19200 Background: While multidisciplinary teams (MDTs) are considered the “gold standard” of care for cancer patients, their performance varies widely. This study aimed to develop a user friendly, reliable and valid self-assessment tool for MDTs to evaluate their performance and monitor improvement over time. Methods: Using maturity modelling methodology, key themes from the literature were developed into a 2-dimensional matrix comprising 17 indicators (within 6 components) across 5 levels of performance. A modified Delphi methodology (where 38 MDT members each assigned the contents to components and performance levels using card sorting software) was used to establish face and content validity. A 10 minute on-line version of the matrix was piloted across 11 MDTs. Each participant estimated where they thought the MDT performed for each indicator. Correlation and factor analyses examining convergent and discriminant validity were conducted using SPSS. Cronbach alpha was used to measure internal consistency and evaluate reliability. Ease of use and usefulness were also examined. Results: A total of 109 members completed the matrix, with representation from medical, nursing and allied health professionals. The mean results for each indicator are shown below (maximum 5). Overall results for the different teams varied from 1.2 to 4.2, with standard deviations ranging from 0.4 to 0.8. Conclusions: This matrix has the potential to be a simple, valid and reliable tool for MDTs to measure their performance and monitor improvement over time. The tool will now be refined and then disseminated to a wider audience for further validation and feedback. [Table: see text]

Tu1703 DIAGNOSIS OF HEPATOPULMONARY SYNDROME IN A LARGE INTEGRATED HEALTH SYSTEM

2020 ◽  
Vol 158 (6) ◽  
pp. S-1460-S-1461
Author(s):  
Shoma Bommena ◽  
Nael Haddad ◽  
Sumit Agarwal ◽  
Sarabdeep Mann ◽  
Layth AL-Jashaami ◽  
...  
Keyword(s):  
Health System ◽  
Hepatopulmonary Syndrome ◽  
Integrated Health

Evaluation of the Modified Naranjo Criteria for Assessing Causal Attribution of Clinical Outcome to Homeopathic Intervention as Presented in Case Reports

Homeopathy ◽  
2020 ◽  
Vol 109 (04) ◽  
pp. 191-197
Author(s):  
Chetna Deep Lamba ◽  
Vishwa Kumar Gupta ◽  
Robbert van Haselen ◽  
Lex Rutten ◽  
Nidhi Mahajan ◽  
...  
Keyword(s):  
Clinical Outcome ◽  
Causal Relationship ◽  
Clinical Case ◽  
Assessment Tool ◽  
Causal Attribution ◽  
Case Reports ◽  
Face Validity ◽  
Rater Agreement ◽  
The Face ◽  
Selection Of

Abstract Objectives The objective of this study was to establish the reliability and content validity of the “Modified Naranjo Criteria for Homeopathy—Causal Attribution Inventory” as a tool for attributing a causal relationship between the homeopathic intervention and outcome in clinical case reports. Methods Purposive sampling was adopted for the selection of information-rich case reports using pre-defined criteria. Eligible case reports had to fulfil a minimum of nine items of the CARE Clinical Case Reporting Guideline checklist and a minimum of three of the homeopathic HOM-CASE CARE extension items. The Modified Naranjo Criteria for Homeopathy Inventory consists of 10 domains. Inter-rater agreement in the scoring of these domains was determined by calculating the percentage agreement and kappa (κ) values. A κ greater than 0.4, indicating fair agreement between raters, in conjunction with the absence of concerns regarding the face validity, was taken to indicate the validity of a given domain. Each domain was assessed by four raters for the selected case reports. Results Sixty case reports met the inclusion criteria. Inter-rater agreement/concordance per domain was “perfect” for domains 1 (100%, κ = 1.00) and 2 (100%, κ = 1.00); “almost perfect” for domain 8 (97.5%, κ = 0.86); “substantial” for domains 3 (96.7%, κ = 0.80) and 5 (91.1%, κ = 0.70); “moderate” for domains 4 (83.3%, κ = 0.60), 7 (67.8%, κ = 0.46) and 9 (99.2%, κ = 0.50); and “fair” for domain 10 (56.1%, κ = 0.38). For domains 6A (46.7%, κ = 0.03) and 6B (50.3%, κ = 0.18), there was “slight agreement” only. Thus, the validity of the Modified Naranjo Criteria for Homeopathy tool was established for each of its domains, except for the two that pertain to direction of cure (domains 6A and 6B). Conclusion The Modified Naranjo Criteria for Homeopathy—Causal Attribution Inventory was identified as a valid tool for assessing the likelihood of a causal relationship between a homeopathic intervention and clinical outcome. Improved wordings for several criteria have been proposed for the assessment tool, under the new acronym “MONARCH”. Further assessment of two MONARCH domains is required.

Sign in / Sign up

Export Citation Format

Share Document