Development and Psychometric Evaluation of the Telenursing Interaction and Satisfaction Scale (TISS)

Author(s):  
Marie Mattisson ◽  
Sussanne Börjeson ◽  
Malou Lindberg ◽  
Kristofer Årestedt

Abstract Background: In telenursing, interaction between caller and telenurse is crucial for outcomes such as adherence, safety and satisfaction. There is a recurring demand for improved interaction in telenursing and a lack of measurement scales focusing on caller satisfaction with interaction. The purpose of this study was to develop and evaluate psychometric properties of the Telenursing Interaction and Satisfaction Scale (TISS).Methods: This instrumental development stud was based on cross-sectional data. Callers to the National Medical Advisory Service in Sweden (n=616) completed a 60-item questionnaire, the Telenursing Interaction and Satisfaction Questionnaire (TISQ). Twenty-five of these items were selected to form the TISS. Selected items represent four dimensions of interaction according to the Interaction Model of Client Health Behavior; health information, professional-technical competence, affective support and decisional control. Data quality was evaluated in terms of missing data patterns and score distributions. Factor structure of the scale was evaluated with confirmatory factor analysis, convergent validity with Spearman correlations, internal consistency with ordinal alpha, scale reliability with composite reliability coefficients, and test-retest reliability with intraclass correlations. Results: The amount of missing data was acceptable and equally distributed. The completeness of data was the highest for the subscale of professional-technical competencies (94%) and the lowest for the TISS total scale (80%). Data deviated significantly from a normal distribution, but all response options were endorsed. The CFA confirmed the hypothesized four-factor structure. Factor loadings ranged from 0.56 to 0.97, and factor correlations were high (0.88-0.96). Internal consistency (ordinal alpha = 0.82-0.97), scale reliability (0.88-0.99) and test-retest reliability (ICC = 0.77-0.86) were satisfactory for all scales.Conclusion: The TISS holds satisfactory psychometric properties in the study sample. Findings support the use of four sub-scales for measuring caller satisfaction with interaction in telenursing. A total-score can be calculated and used in situations where multi-collinearity is a problem.

BMJ Open ◽  
2020 ◽  
Vol 10 (7) ◽  
pp. e037129
Author(s):  
Emma Säfström ◽  
Lena Nasstrom ◽  
Maria Liljeroos ◽  
Lena Nordgren ◽  
Kristofer Årestedt ◽  
...  

ObjectiveEven though continuity is essential after discharge, there is a lack of reliable questionnaires to measure and assess patients’ perceptions of continuity of care. The Patient Continuity of Care Questionnaire (PCCQ) addresses the period before and after discharge from hospital. However, previous studies show that the factor structure needs to be confirmed and validated in larger samples, and the aim of this study was to evaluate the psychometric properties of the PCCQ with focus on factor structure, internal consistency and stability.DesignA psychometric evaluation study. The questionnaire was translated into Swedish using a forward–backward technique and culturally adapted through cognitive interviews (n=12) and reviewed by researchers (n=8).SettingData were collected in four healthcare settings in two Swedish counties.ParticipantsA consecutive sampling procedure included 725 patients discharged after hospitalisation due to angina, acute myocardial infarction, heart failure or atrial fibrillation.MeasurementTo evaluate the factor structure, confirmatory factor analyses based on polychoric correlations were performed (n=721). Internal consistency was evaluated by ordinal alpha. Test–retest reliability (n=289) was assessed with intraclass correlation coefficient (ICC).ResultsThe original six-factor structure was overall confirmed, but minor refinements were required to reach satisfactory model fit. The standardised factor loadings ranged between 0.68 and 0.94, and ordinal alpha ranged between 0.82 and 0.95. All subscales demonstrated satisfactory test–retest reliability (ICC=0.76–0.94).ConclusionThe revised version of the PCCQ showed sound psychometric properties and is ready to be used to measure perceptions of continuity of care. High ordinal alpha in some subscales indicates that a shorter version of the questionnaire can be developed.


2019 ◽  
Vol 41 (4) ◽  
pp. 283-299 ◽  
Author(s):  
Jinhee Park ◽  
Britt Frisk Pados ◽  
Suzanne M. Thoyre ◽  
Hayley H. Estrem ◽  
Cara McComish

The purpose of this study was to identify the factor structure of the Child Oral and Motor Proficiency Scale (ChOMPS) and to evaluate the psychometric properties, including internal consistency reliability, test–retest reliability, and construct validity as measured by convergent and known-groups validity. Principal component analysis with varimax rotation conducted on responses from 364 parents of children between 6 months and 7 years of age identified four subscales: complex movement patterns, basic movement patterns, oral-motor coordination, and fundamental oral-motor skills. Acceptable internal consistency reliability (Cronbach’s α = .97) and test–retest reliability ( r = .98) were found. Convergent and known-groups validity were supported by significant associations between the ChOMPS and validation measures, as well as significant differences in the ChOMPS scores between children with and without feeding problems. The ChOMPS is a 63-item parent-report measure of eating, drinking, and related motor skills in children aged 6 months to 7 years with evidence of reliability and validity.


2017 ◽  
Vol 41 (S1) ◽  
pp. S70-S70
Author(s):  
A. Galhardo ◽  
J. Pinto-Gouveia ◽  
M. Cunha ◽  
I. Massano-Cardoso

IntroductionSelf-report instruments are useful tools for the assessment of psychopathological symptoms such as obsessive-compulsive symptoms. The Padua Inventory (PI) is a measure that has been widely used in clinical and research settings and studied in several countries.ObjectivesThis study explores the psychometric properties and factor structure of the Portuguese version of the PI.MethodsTranslation and translation-back of the original version were executed. A total of 847 participants (468 women and 379 men) from the general population was recruited through a snowball procedure and completed the PI and other mental health measures. The data set was randomly split in order to conduct principal component analysis (PCA) and confirmatory factor (CFA) analysis in two different samples. Moreover, internal consistency, convergent and discriminant validity and test-retest reliability analyses were conducted.ResultsFrom the PCA analysis four factors emerged, comprising clusters of items related to doubting/impaired control over mental activities, contamination/washing/cleaning, checking and worries about losing control over motor behaviors. CFA results revealed that the model presented a poor fit to the data and indicated that the model would benefit from the establishment of correlations between pairs of error terms of items with identical contents. The PI exhibited excellent internal consistency, good test-retest reliability and good convergent and discriminant validity.ConclusionsThe PI Portuguese version showed a similar factor structure to the one presented in other studies and revealed good psychometric properties. Nevertheless, results from the CFA suggest that shortening the PI may be advantageous.Disclosure of interestThe authors have not supplied their declaration of competing interest.


2021 ◽  
Vol 22 (1) ◽  
Author(s):  
Amin Kordi Yoosefinejad ◽  
Fatemeh Karjalian ◽  
Marzieh Momennasab ◽  
Shahrokh Ezzatzadegan Jahromi

Abstract Background Hemodialysis is considered a major therapeutic method for patients with chronic kidney disease. Pruritus is a common complaint of hemodialysis patients. The 5-D pruritus scale is amongst the most common tools to evaluate several dimensions of itch. Psychometric properties of the 5-D scale have not been evaluated in Persian speaking population with hemodialysis; hence, the objective of this study was to assess reliability and validity of the Persian version of the scale. Methods Ninety hemodialysis patients (men: 50, women: 40, mean age: 54.4 years) participated in this cross-sectional study. The final Persian version of 5-D scale was given to the participants. Tests Compared: One-third of the participants completed the scale twice within 3–7 days apart to evaluate test- retest reliability. Other psychometric properties including internal consistency, absolute reliability, convergent, discriminative and construct validity, floor/ceiling effects were also evaluated. Results The Persian 5-D scale has strong test-retest reliability (ICC= 0.98) and internal consistency (Cronbach’s alpha= 0.99). Standard error of measurement and minimal detectable change were 0.33 and 0.91, respectively. Regarding convergent validity, the scale had moderate correlation with numeric rating scale (r =0.67) and quality of life questionnaire related to itch (r = 0.59). Exploratory factor analysis revealed two factors within the scale. No floor or ceiling effect was found for the scale. Conclusion The Persian version of 5-D the itching scale is a brief instrument with acceptable reliability and validity. Therefore, the scale could be used by experts, nurses, and other health service providers to evaluate pruritus among Persian speaking hemodialysis patients.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Liyuan Cui ◽  
Yaxin Zhu ◽  
Jinglou Qu ◽  
Liming Tie ◽  
Ziqi Wang ◽  
...  

Abstract Background Critical thinking disposition helps medical students and professionals overcome the effects of personal values and beliefs when exercising clinical judgment. The lack of effective instruments to measure critical thinking disposition in medical students has become an obstacle for training and evaluating students in undergraduate programs in China. The aim of this study was to evaluate the psychometric properties of the CTDA test. Methods A total of 278 students participated in this study and responded to the CTDA test. Cronbach’s α coefficient, internal consistency, test-retest reliability, floor effects and ceiling effects were measured to assess the reliability of the questionnaire. Construct validity of the pre-specified three-domain structure of the CTDA was evaluated by explanatory factor analysis (EFA) and confirmatory factor analysis (CFA). The convergent validity and discriminant validity were also analyzed. Results Cronbach’s alpha coefficient for the entire questionnaire was calculated to be 0.92, all of the domains showed acceptable internal consistency (0.81–0.86), and the test-retest reliability indicated acceptable intra-class correlation coefficients (ICCs) (0.93, p < 0.01). The EFA and the CFA demonstrated that the three-domain model fitted the data adequately. The test showed satisfactory convergent and discriminant validity. Conclusions The CTDA is a reliable and valid questionnaire to evaluate the disposition of medical students towards critical thinking in China and can reasonably be applied in critical thinking programs and medical education research.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Nadia Younes ◽  
Anne Laure Delaunay ◽  
M. Roger ◽  
Pierre Serra ◽  
France Hirot ◽  
...  

Abstract Background Training in psychiatry requires specific knowledge, attitudes, and skills that are obtainable by simulation, of which the use is only recent and still needs further development. Evidence is accumulating on its effectiveness but requires further validation for medical students. We aimed to evaluate the effectiveness of a single-day optional teaching program in psychiatry by simulation for medical students and validate a scale measuring Confidence in Psychiatric Clinical Skills (CPCQ), as part of the assessment. Methods This was a controlled study in a French University that compared (using paired-sample Student t-tests) knowledge and attitudes (university grades and CPCQ scores) before, just after teaching with simulated patients, and 2 months later. Satisfaction with the program (including the quality of the debriefing) was also investigated. The CPCQ scale was validated by assessing the factor structure, internal consistency, and test-retest reliability. Finally, a comparison was run with a control group who received the usual psychiatric instruction using covariance analyses. Results Twenty-four medical students were included in the simulation group and 76 in the control group. Just after the simulation, knowledge and attitudes increased significantly in the simulation group. Satisfaction with the training and debriefing was very high. The CPCQ scale showed good psychometric properties: a single-factor structure, acceptable internal consistency (α = 0.73 [0.65–0.85]), and good test-retest reliability (ICC = 0.71 [0.35–0.88]). Two months after the simulation, knowledge and attitudes were significantly higher in the simulation group than the control group, despite a lack of difference in knowledge before the simulation. Conclusions Adding a simulation program in psychiatry to the usual teaching improved the knowledge and confidence of medical students. The CPCQ scale could be used for the evaluation of educational programs.


2017 ◽  
Vol 32 (2) ◽  
Author(s):  
Shannon Gwin ◽  
Paul Branscum ◽  
E. Laurette Taylor

The purpose of this study was to create a valid and reliable instrument to evaluate theory-basedbeliefs towards physical activity among clergy members. Data were collected from 174 clergy that par-ticipated in a 15-item online and paper-based survey. Psychometric properties of the instrument includedconfirmatory factor analysis (construct validity), and cronbach’s alpha (internal consistency reliability).In addition, the stability (test-retest reliability) of each subscale was evaluated with a sub-sample of 30participants. Results show the instrument was both valid and reliable, and will be useful in future studiestargeting this population. Future implications are discussed.


2021 ◽  
Vol 39 (15_suppl) ◽  
pp. e24027-e24027
Author(s):  
Jaba Kokhreidze ◽  
Veleka Allen ◽  
Cristina Ivanescu ◽  
Xiaopan Valerie Yao ◽  
Bin Zhang ◽  
...  

e24027 Background: The ongoing two-part phase 2/3 RESILIENT study (NCT03088813) is investigating the efficacy and safety of liposomal irinotecan monotherapy in patients with SCLC who have progressed on or after first line platinum-based chemotherapy. This exploratory analysis from RESILIENT part 1 was conducted to confirm the psychometric properties of established PRO instruments that had not previously been validated in patients with SCLC. Methods: Patients completed the European Organisation for Research and Treatment of Cancer Quality of Life Questionnaire (EORTC QLQ) Core 30 (C30) and the EORTC QLQ Lung Cancer 13 (LC13) before treatment assignment (baseline), every 6 weeks thereafter, at treatment discontinuation and at the 30-day follow-up visit. Psychometric methods included descriptive statistics (items and scales), correlations (item-to-item and item-to-total), internal consistency (Cronbach’s α), test-retest reliability (intraclass correlation coefficient [ICC], two-way random effects model), construct validity and sensitivity to change. The analysis included patients who received at least one dose of study drug and completed at least one PRO assessment. Results: Thirty patients were enrolled in RESILIENT part 1 and included in the analysis. At baseline, 68% of patients reported ‘not severe’ or ‘mild’ symptoms. Floor effects (i.e. more than 25% of responses of ‘not at all’) were observed for several of the functioning/impact and symptom scales of the EORTC QLQ C30 and LC13. Moderate to strong correlations were found among most questionnaire items within their respective scales. Acceptable evidence for internal consistency and good test-retest reliability were observed. Selected results for the EORTC QLQ LC13, including dyspnea scales, are shown in the Table. The magnitude of correlations among PRO instruments supported evidence for convergent validity in this sample. Conclusions: In RESILIENT part 1, patients experienced low and tolerable symptoms at enrollment, limiting the potential for further improvement. Overall, these PRO instruments had acceptable psychometric properties (e.g. construct validity, reliability and ability to detect change) in this sample. However, these analyses should be repeated in a larger sample using data from RESILIENT part 2. Clinical trial information: NCT03088813. [Table: see text]


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Adam Polnay ◽  
Helen Walker ◽  
Christopher Gallacher

Purpose Relational dynamics between patients and staff in forensic settings can be complicated and demanding for both sides. Reflective practice groups (RPGs) bring clinicians together to reflect on these dynamics. To date, evaluation of RPGs has lacked quantitative focus and a suitable quantitative tool. Therefore, a self-report tool was designed. This paper aims to pilot The Relational Aspects of CarE (TRACE) scale with clinicians in a high-secure hospital and investigate its psychometric properties. Design/methodology/approach A multi-professional sample of 80 clinicians were recruited, completing TRACE and attitudes to personality disorder questionnaire (APDQ). Exploratory factor analysis (EFA) determined factor structure and internal consistency of TRACE. A subset was selected to measure test–retest reliability. TRACE was cross-validated against the APDQ. Findings EFA found five factors underlying the 20 TRACE items: “awareness of common responses,” “discussing and normalising feelings;” “utilising feelings,” “wish to care” and “awareness of complicated affects.” This factor structure is complex, but items clustered logically to key areas originally used to generate items. Internal consistency (α = 0.66, 95% confidence interval (CI) = 0.55–0.76) demonstrated borderline acceptability. TRACE demonstrated good test–retest reliability (intra-class correlation = 0.94, 95% CI = 0.78–0.98) and face validity. TRACE indicated a slight negative correlation with APDQ. A larger data set is needed to substantiate these preliminary findings. Practical implications Early indications suggested TRACE was valid and reliable, suitable to measure the effectiveness of reflective practice. Originality/value The TRACE was a distinctive measure that filled a methodological gap in the literature.


2019 ◽  
pp. 174-180
Author(s):  
Fatemeh Sadat Bateni ◽  
Maryam Rahmatian ◽  
Ahmad Kaviani ◽  
Sebastian Simard ◽  
Mehdi Soleimani ◽  
...  

Background: This study aimed to translate and validate the Fear of Cancer Recurrence Inventory (FCRI) questionnaire into Persian and to investigate its psychometric properties. Methods: The FCRI was translated to Persian using a linguistic methodology according to WHO guidelines. A total of 450 breast cancer survivors who had the following inclusion criteria were included: time elapse of more than six months after the treatment prior to the study; absence ofobjective markers of recurrence, fluency in the Persian language, and signing the informed consent. Internal consistency was estimated with Cronbach's α coefficient and test-retest reliability with Interclass correlation.  Concurrent validity was estimated through Pearson’s correlation between the FCRI and Hospital Anxiety and Depression Scale (HADS). Principal component analysis (PCA) and confirmatory factor analysis (CFA) were employed to evaluate dimensionality. Results: The Persian version was acceptable for patients. The content validity index (CVI) was 0.80.  The instrument had good test-retest reliability (ICC= 0.96) and internal consistency (Cronbach’s α=0.86).  PCA and CFA indicated that the factor structure of the Persian version was similar to the original questionnaire and had acceptable goodness of fit.  Correlations between the FCRI and HADS was remarkable (r= 0.252 – 0.639), indicating acceptable concurrent validity. Conclusions: The Persian version of FCRI could be considered a good cross-cultural equivalent for the original English version. The questionnaire was a reliable and valid instrument in terms of internal consistency, test-retest reliability, and dimensionality.


Sign in / Sign up

Export Citation Format

Share Document