scholarly journals Validity and reliability of new instruments for measuring patient satisfaction with removable dentures, Arabic Version

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Ahmad Al Jaghsi ◽  
Musab Saeed ◽  
Salem Abu Fanas ◽  
Ahmed Yaseen Alqutaibi ◽  
Torsten Mundt

Abstract Background The psychometric properties of self-administered instruments for measuring patient satisfaction with removable dentures should be tested before inviting patients to express their opinions. This study aimed to evaluate the validity and reliability of new instruments in the Arabic language that measure patient satisfaction with all types of removable dentures. Methods A three-step methodology was used to translate and test the instruments. In step one, the instruments were translated from tested German instruments to develop the pilot questionnaires. In step two, the face validity of the pilot questionnaires was tested through three rounds of interviews. There were 15, 13, and 15 participants per round, respectively. At the end of every round, the results of the interviews were discussed with an expert panel. The expert panel confirmed the form and the type of questionnaires’ adjustments before a new round of interviews began. At the end of step two, the final form of the questionnaires was reached. In step three, 235 questionnaires were distributed to 133 participants to estimate the construct validity of the upper jaw and the lower jaw questionnaires. After one week, the participants were asked to complete the questionnaires again. A total of 102 questionnaires were returned and used to assess the instruments’ reliability. Factor analysis was used to assess the construct validity. The intraclass correlation coefficient and Cronbach’s alpha were used to estimate the reliability and suitability of the items in the indexes. Results The result of step one was two pilot questionnaires. The pilot questionnaires were adjusted in step two. At the end of step two, the questionnaires proved to have good face validity. Factor analyses in step three revealed that only one factor could be retained. The one-factor model explained 60.95% and 63.06 of the total variance of the upper jaw and lower jaw questionnaires, respectively. The items in every questionnaire shared the same cluster and could be summed to form an upper jaw index and lower jaw index that reflected patient satisfaction with removable dentures. Cronbach’s alpha values indicated excellent internal consistency and reliability for the upper jaw questionnaire (α = 0.91) and the lower jaw questionnaire (α = 0.92). Intraclass correlation coefficient values ranged from 0.72 to 0.95, which can be considered “moderate” to “excellent”. Conclusions The Arabic version of questionnaires and indexes assessing patient satisfaction with upper and lower removable dentures are reliable and valid self-administered instruments.


2020 ◽  
Author(s):  
Tamana Afzali ◽  
Henrik Hein Lauridsen ◽  
Janus Laust Thomsen ◽  
Jan Hartvigsen ◽  
Martin Bach Jensen ◽  
...  

BACKGROUND Low back pain is highly prevalent, and most often, a specific causative factor cannot be identified. Therefore, for most patients, their low back pain is labeled as nonspecific. Patient education and information are recommended for all these patients. The internet is an accessible source of medical information on low back pain. Approximately 50% of patients with low back pain search the internet for health and medical advice. Patient satisfaction with education and information is important in relation to patients’ levels of inclination to use web-based information and their trust in the information they find. Although patients who are satisfied with the information they retrieve use the internet as a supplementary source of information, dissatisfied patients tend to avoid using the internet. Consumers’ loyalty to a product is often applied to evaluate their satisfaction. Consumers have been shown to be good ambassadors for a service when they are willing to recommend the service to a friend or colleague. When consumers are willing to recommend a service to a friend or colleague, they are also likely to be future users of the service. To the best of our knowledge, no multi-item instrument exists to specifically evaluate satisfaction with information delivered on the web for people with low back pain. OBJECTIVE This study aims to report on the development, reliability testing, and construct validity testing of the Online Patient Satisfaction Index to measure patients’ satisfaction with web-based information for low back pain. METHODS This is a cross-sectional validation study of the Online Patient Satisfaction Index. The index was developed with experts and assessed for face validity. It was subsequently administered to 150 adults with nonspecific low back pain. Of these, 46% (70/150) were randomly assigned to participate in a reliability test using an intraclass correlation coefficient of agreement. Construct validity was evaluated by hypothesis testing based on a web app (MyBack) and Wikipedia on low back pain. RESULTS The index includes 8 items. The median score (range 0-24) based on the MyBack website was 20 (IQR 18-22), and the median score for Wikipedia was 12 (IQR 8-15). The entire score range was used. Overall, 53 participants completed a retest, of which 39 (74%) were stable in their satisfaction with the home page and were included in the analysis for reliability. Intraclass correlation coefficient of agreement was estimated to be 0.82 (95% CI 0.68-0.90). Two hypothesized correlations for construct validity were confirmed through an analysis using complete data. CONCLUSIONS The index had good face validity, excellent reliability, and good construct validity and can be used to measure satisfaction with the provision of web-based information regarding nonspecific low back pain among people willing to access the internet to obtain health information. CLINICALTRIAL ClinicalTrials.gov NCT03449004; https://clinicaltrials.gov/ct2/show/NCT03449004



10.2196/21462 ◽  
2021 ◽  
Vol 5 (11) ◽  
pp. e21462
Author(s):  
Tamana Afzali ◽  
Henrik Hein Lauridsen ◽  
Janus Laust Thomsen ◽  
Jan Hartvigsen ◽  
Martin Bach Jensen ◽  
...  

Background Low back pain is highly prevalent, and most often, a specific causative factor cannot be identified. Therefore, for most patients, their low back pain is labeled as nonspecific. Patient education and information are recommended for all these patients. The internet is an accessible source of medical information on low back pain. Approximately 50% of patients with low back pain search the internet for health and medical advice. Patient satisfaction with education and information is important in relation to patients’ levels of inclination to use web-based information and their trust in the information they find. Although patients who are satisfied with the information they retrieve use the internet as a supplementary source of information, dissatisfied patients tend to avoid using the internet. Consumers’ loyalty to a product is often applied to evaluate their satisfaction. Consumers have been shown to be good ambassadors for a service when they are willing to recommend the service to a friend or colleague. When consumers are willing to recommend a service to a friend or colleague, they are also likely to be future users of the service. To the best of our knowledge, no multi-item instrument exists to specifically evaluate satisfaction with information delivered on the web for people with low back pain. Objective This study aims to report on the development, reliability testing, and construct validity testing of the Online Patient Satisfaction Index to measure patients’ satisfaction with web-based information for low back pain. Methods This is a cross-sectional validation study of the Online Patient Satisfaction Index. The index was developed with experts and assessed for face validity. It was subsequently administered to 150 adults with nonspecific low back pain. Of these, 46% (70/150) were randomly assigned to participate in a reliability test using an intraclass correlation coefficient of agreement. Construct validity was evaluated by hypothesis testing based on a web app (MyBack) and Wikipedia on low back pain. Results The index includes 8 items. The median score (range 0-24) based on the MyBack website was 20 (IQR 18-22), and the median score for Wikipedia was 12 (IQR 8-15). The entire score range was used. Overall, 53 participants completed a retest, of which 39 (74%) were stable in their satisfaction with the home page and were included in the analysis for reliability. Intraclass correlation coefficient of agreement was estimated to be 0.82 (95% CI 0.68-0.90). Two hypothesized correlations for construct validity were confirmed through an analysis using complete data. Conclusions The index had good face validity, excellent reliability, and good construct validity and can be used to measure satisfaction with the provision of web-based information regarding nonspecific low back pain among people willing to access the internet to obtain health information. Trial Registration ClinicalTrials.gov NCT03449004; https://clinicaltrials.gov/ct2/show/NCT03449004



Author(s):  
Marziyeh Arman ◽  
Lisa M. Barnett ◽  
Steven J. Bowe ◽  
Abbas Bahram ◽  
Anoshirvan Kazemnejad

The aim of this study was to determine the validity and reliability of the Perceived Movement Skill Competence scales for Iranian children. In particular, the scales aligned with the second and third versions of the Test of Gross Motor Development and the active play skills. The total sample was 314 children aged 4–8 years (Mage = 6.1 years, SD = 1.1). From this, a random sample of 74 were recruited for face validity. The data from the remaining 240 children were used to establish construct validity using Bayesian Structural Equation Modeling. The data from a second random subsample of 126 children were used to investigate Perceived Movement Skill Competence reliability using ordinal alpha coefficients and intraclass correlations coefficients. The majority of children correctly identified the skills and understood most of the pictures. Internal consistency was very good (from 0.81 to 0.95) for all scales and subscales. Test–retest reliability was excellent with intraclass correlation coefficient values above .85. For construct validity, the initial hypothesized models for three-factor (i.e., locomotor, object control, and play skills) and two-factor (i.e., locomotor and object control) models showed a reasonable fit. The pictorial scales for Perceived Movement Skill Competence are valid and reliable for Iranian young children.



Author(s):  
Mihyeon Seong ◽  
Juyoung Park ◽  
Soojin Chung ◽  
Sohyune Sok

This study aimed to develop an instrument for measuring the attitudes that reflect the characteristics of the pandemic (Adult Pandemic Attitude Scale (A-PAS)) and verifying its validity and reliability. This study used a methodological research design and was conducted with a development step and an evaluation step. The development step included development of preliminary items, content validity, face validity, and preliminary investigation. The evaluation step included item analysis, construct validity, convergent validity, discriminant validity, criterion validity, factor naming, reliability, and completion of the final instrument. The A-PAS developed in this study consisted of a total of 20 items in five dimensions. The internal consistency of 20 items of the A-PAS, Cronbach’s α was 0.92 for 20 items, Cronbach’s α for each factor, a subscale of instrument, was 0.61~0.87 and Raykov’s p coefficient of each factor, which is a subscale of the tool, was found to be 0.60 to 0.88. Analysis of construct validity showed the results as follows: χ2 (p) = 134.05 (p < 0.001), RMSEA = 0.02, RMR = 0.02, GFI = 0.94, CFI = 0.99. The study findings suggest that the developed instrument can be utilized to measure the attitudes of adults toward pandemics, and reflect the reality of the pandemic situation. The outcomes can be used as valuable data for intervention, prevention activities, and policy preparation. The instrument will be applied in the event of a pandemic, such as COVID-19, and will be helpful in promoting the health of the people.



10.3823/2575 ◽  
2018 ◽  
Vol 11 ◽  
Author(s):  
Mauricio Arias ◽  
Sonia Carreño ◽  
Lorena Chaparro

Objective: To determine face, content, and construct validity, and internal consistency of ROL scale. Methods and Findings: A three-phase study was conducted. First, content analysis of the scale was carried out consulting 10 professional experts. Then, face validity was analyzed with 60 caregivers. Finally, construct validity was evaluated by performing an exploratory factor analysis (EFA) with 110 participants. Internal consistency of ROL scale was also assessed. Face validity of ROL scale reached a high acceptance index in three dimensions: role performance (0.97), role organization (0.98), and response to the role (0.98). Content validity showed coherence, clarity, and relevance of the scale. From factor analysis, three components emerged and were grouped in the same manner for varimax, quartimax, and equimax rotations. Cronbach's alpha was 0.816, which is an acceptable overall value. Conclusion: ROL scale makes objective the concept of role taking in family caregivers of people with chronic disease. It demonstrated to have acceptable reliability, and construct, face, and content validity to be used in the Colombian context. Keywords: Validation Study, Caregivers, Health Transitions, Chronic Disease.



2012 ◽  
Vol 46 (4) ◽  
pp. 702-711 ◽  
Author(s):  
Daniel Apolinario ◽  
Rafaela de Castro Oliveira Pereira Braga ◽  
Regina Miksian Magaldi ◽  
Alexandre Leopold Busse ◽  
Flavia Campora ◽  
...  

OBJECTIVE: To develop and validate a short health literacy assessment tool for Portuguese-speaking adults. METHODS: The Short Assessment of Health Literacy for Portuguese-speaking Adults is an assessment tool which consists of 50 items that assess an individual's ability to correctly pronounce and understand common medical terms. We evaluated the instrument's psychometric properties in a convenience sample of 226 Brazilian older adults. Construct validity was assessed by correlating the tool scores with years of schooling, self-reported literacy, and global cognitive functioning. Discrimination validity was assessed by testing the tool's accuracy in detecting inadequate health literacy, defined as failure to fully understand standard medical prescriptions. RESULTS: Moderate to high correlations were found in the assessment of construct validity (Spearman's coefficients ranging from 0.63 to 0.76). The instrument showed adequate internal consistency (Cronbach's alpha=0.93) and adequate test-retest reliability (intraclass correlation coefficient=0.95). The area under the receiver operating characteristic curve for detection of inadequate health literacy was 0.82. A version consisting of 18 items was tested and showed similar psychometric properties. CONCLUSIONS: The instrument developed showed good validity and reliability in a sample of Brazilian older adults. It can be used in research and clinical settings for screening inadequate health literacy.



Author(s):  
Lindie J.M.K. Kuijpers ◽  
Mathijs Binkhorst ◽  
Nicole K. Yamada ◽  
Romy N. Bouwmeester ◽  
Arno F.J. van Heijst ◽  
...  

Objective This study aimed to evaluate the construct validity and reliability of real-time assessment of a previously developed neonatal intubation scoring instrument (NISI). Study Design We performed a randomized controlled simulation study at a simulation-based research and training facility. Twenty-four clinicians experienced in neonatal intubation (“experts”) and 11 medical students (“novices”) performed two identical elective intubations on a neonatal patient simulator. Subjects were randomly assigned to either the intervention group, receiving predefined feedback between the two intubations, or the control group, receiving no feedback. Using the previously developed NISI, all intubations were assessed, both in real time and remotely on video. Construct validity was evaluated by (1) comparing the intubation performances, expressed as percentage scores, with and without feedback, and (2) correlating the intubation performances with the subjects' level of experience. The intrarater reliability, expressed as intraclass correlation coefficient (ICC), of real-time assessment compared with video-based assessment was determined. Results The intervention group contained 18 subjects, the control group 17. Background characteristics and baseline intubation scores were comparable in both groups. The median (IQR) change in percentage scores between the first and second intubation was significantly different between the intervention and control group (11.6% [4.7–22.8%] vs. 1.4% [0.0–5.7%], respectively; p = 0.013). The 95% CI for this 10.2% difference was 2.2 to 21.4%. The subjects' experience level correlated significantly with their percentage scores (Spearman's R = 0.70; p <0.01). ICC's were 0.95 (95% CI: 0.89–0.97) and 0.94 (95% CI: 0.89–0.97) for the first and second intubation, respectively. Conclusion Our NISI has construct validity and is reliable for real-time assessment. Key Points



2003 ◽  
Vol 12 (1) ◽  
pp. 53-62 ◽  
Author(s):  
Pierluigi Morosini ◽  
Antonella Gigantesco ◽  
Angelica Mazzarda ◽  
Loredana Gibaldi

SUMMARYAims– To clarify the acceptability, reliability and factorial validity of a new Italian version of the HoNOS called HoNOS-Rome. Its main innovations are both in design and in contents.Methods– Face validity was assessed by surveying 3 focus groups. Reliability was assessed in 8 different pairs of raters on a sample of 24 patients; construct validity was analysed by factor analysis using a sample of 187 patients at 6 day centres. Acceptability was investigated by means an anonymous questionnaire filled by professionals that were using the instrument.Results– Time of completion was low (range 4–12 minutes), the tool proved very acceptable and the reliability was good (weighted kappa ≥ 0.71 for all items). Factor analysis was consistent with the division of HoNOS–Rome into four sensible factors accounting for 52% of the total variance.Conclusions– The findings indicate that HoNOS–Rome has a satisfactory degree of acceptability, construct validity and reliability, and may promote the routine evaluation of outcomes in mental health services.Declaration of Interest: the authors declare that the study was supported by grant no. 96/Q/T41 of the Italian National Mental Health Project – Istituto Superiore di Sanità – Sub-project: Development and validation of tools for outcome evaluation of mental health services, Italy (Professor P. Morosini).



2017 ◽  
Vol 66 (1) ◽  
pp. 19-28
Author(s):  
Hugo Rafael de Souza e Silva ◽  
Kelsy Catherina Nema Areco ◽  
Paulo Bandiera-Paiva ◽  
Pauliana Valéria Machado Galvão ◽  
Analia Nusya de Medeiros Garcia ◽  
...  

ABSTRACT Objective To evaluate construct validity and reliability of the Portuguese (Brazil) version of Online Cognition Scale (OCS-BR). Methods Portuguese (Brazil) versions of Online Cognition Scale (OCS), of Internet Addiction Test (IAT) and socio demographic questionnaire was applied to a sample (n = 359) of health university students. Construct validity evidence was verified through the factorial and convergent validity by Confirmatory Factor Analysis (CFA) and internal consistency and stability analysis through Cronbach’s alpha and intraclass correlation coefficient (ICC) respectively. Discriminative power of items were analyzed using item-total correlation and point biserial correlation. Results OCS-BR presented satisfactory evidence of construct validity. The instrument showed Cronbach’s alpha of 0.91 and ICC of 0.91. Conclusion Portuguese (Brazil) version of OCS shows items consistently gatherd to measure the Problematic Internet Use (PIU) construct, it is considered s stable instrument in time and with sufficient evidence of construct validity.



2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Doris van der Smissen ◽  
Agnes van der Heide ◽  
Rebecca L. Sudore ◽  
Judith A. C. Rietjens ◽  
Ida J. Korfage

Abstract Background Advance care planning (ACP) enables people to define, discuss, and record preferences for treatment and care. Measures of ACP behavior are lacking in the Netherlands. We aimed to translate, culturally adapt and validate the 34-item ACP Engagement Survey into Dutch. Methods Following validation guidelines, we tested content validity, internal consistency, reproducibility, construct validity, interpretability and criterion validity among persons with and without chronic disease. Results Forward-backward translation indicated the need of only minor adaptations. Two hundred thirty-two persons completed baseline and retest surveys; 121 were aged ≥60 years. Persons with chronic disease (n = 151) considered the survey more valuable than those without (66 vs. 59, p < 0.001, scale of 20–100), indicating good content validity. Internal consistency (Cronbach’s alpha: 0.97) and reproducibility (intraclass correlation: 0.88) were good. Total ACP Engagement was higher among persons with chronic disease than those without (2.9 vs. 2.4, p < 0.01, scale of 1 to 5), indicating good psychometric support for construct validity and interpretability. Positive correlations of the ACP Engagement Survey and the General Self-Efficacy survey indicated good criterion validity (p < 0.05). Conclusions This study provided good psychometric support for the validity and reliability of the Dutch 34-item ACP Engagement Survey. This instrument can be used to assess involvement in ACP in adults with and without chronic disease.



Sign in / Sign up

Export Citation Format

Share Document